Apr 14 01:36:41 user cinder-volume[73480]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73480) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 01:36:41 user cinder-volume[73480]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73480) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 01:36:41 user cinder-volume[73480]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73480) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 01:36:41 user cinder-volume[73480]: INFO dbcounter [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Registered counter for database cinder Apr 14 01:36:41 user cinder-volume[73480]: DEBUG oslo_db.sqlalchemy.engines [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73480) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:36:41 user cinder-volume[73480]: DEBUG dbcounter [-] [73480] Writer thread running {{(pid=73480) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:36:42 user cinder-volume[73480]: INFO cinder.rpc [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 01:36:42 user cinder-volume[73480]: INFO cinder.rpc [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_db.sqlalchemy.engines [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73480) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:36:42 user cinder-volume[73480]: INFO cinder.volume.manager [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Determined volume DB was empty at startup. Apr 14 01:36:42 user cinder-volume[73480]: DEBUG cinder.volume.manager [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73480) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Apr 14 01:36:42 user cinder-volume[73480]: INFO cinder.volume.manager [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 01:36:42 user cinder-volume[73480]: WARNING stevedore.named [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 01:36:42 user cinder-volume[73480]: WARNING castellan.key_manager [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 01:36:42 user cinder-volume[73480]: WARNING cinder.keymgr.conf_key_mgr [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_db.sqlalchemy.engines [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73480) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:36:42 user cinder-volume[73480]: INFO cinder.rpc [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 14 01:36:42 user cinder-volume[73480]: INFO cinder.rpc [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Apr 14 01:36:42 user cinder-volume[73480]: WARNING stevedore.named [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 01:36:42 user cinder-volume[73480]: WARNING castellan.key_manager [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 01:36:42 user cinder-volume[73480]: INFO cinder.volume.manager [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Image-volume cache enabled for host user@joviandss-2. Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_db.sqlalchemy.engines [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73480) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:36:42 user cinder-volume[73480]: INFO oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Starting 1 workers Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Started child 73579 {{(pid=73480) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Full set of CONF: {{(pid=73480) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] ******************************************************************************** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] Configuration options gathered from: {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] ================================================================================ {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] allow_availability_zone_fallback = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73579]: INFO cinder.service [-] Starting cinder-volume node (version 22.1.0) Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] allow_compression_on_image_upload = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] allowed_direct_url_schemes = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] api_rate_limit = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] auth_strategy = keystone {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] az_cache_duration = 3600 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_availability_zone = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_host = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_stats_polling_interval = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backup_api_class = cinder.backup.api.API {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backup_name_template = backup-%s {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backup_use_same_host = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backup_use_temp_snapshot = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] chap_password = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] chap_password_len = 12 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] chap_username = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_internal_tenant_project_id = 09d20380b49e4ac2a78e44d2973ed7ce {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_internal_tenant_user_id = 52ece6dd04904f1fb7454817f748e0e1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cloned_volume_same_az = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cluster = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] compression_format = gzip {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] compute_api_class = cinder.compute.nova.API {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] config_dir = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] config_source = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] control_exchange = openstack {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] debug = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] default_availability_zone = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] default_group_type = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] default_volume_type = joviandss-2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] driver_client_cert = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] driver_client_cert_key = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] driver_data_namespace = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] driver_ssl_cert_path = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] driver_ssl_cert_verify = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] driver_use_ssl = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] enable_force_upload = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] enable_new_services = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] enable_unsupported_driver = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] enabled_backends = ['joviandss-2'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] enforce_multipath_for_image_xfer = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] filter_function = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_api_insecure = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_api_servers = ['http://10.0.0.210/image'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_api_ssl_compression = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_ca_certificates_file = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_catalog_info = image:glance:publicURL {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_certfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_keyfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_num_retries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] glance_request_timeout = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] goodness_function = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] graceful_shutdown_timeout = 5 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] group_api_class = cinder.group.api.API {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] host = user {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iet_conf = /etc/iet/ietd.conf {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_compress_on_upload = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_conversion_address_space_limit = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_conversion_cpu_limit = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_conversion_disable = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_upload_use_cinder_backend = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_upload_use_internal_tenant = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_volume_cache_enabled = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Starting volume driver JovianISCSIDriver (1.0.2) Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_volume_cache_max_count = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] image_volume_cache_max_size_gb = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] init_host_max_objects_retrieval = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] instance_format = [instance: %(uuid)s] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iscsi_iotype = fileio {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iscsi_target_flags = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iscsi_write_cache = on {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iser_helper = tgtadm {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iser_ip_address = 10.0.0.210 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iser_port = 3260 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] check pool {{(pid=73579) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] jovian_block_size = 64K {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] jovian_ignore_tpath = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] jovian_pool = Pool-0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] jovian_recovery_delay = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_config_append = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_dir = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_file = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_options = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_rotate_interval = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_rotate_interval_type = days {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] log_rotation_type = none {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] max_age = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] max_logfile_count = 30 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] max_logfile_size_mb = 200 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] max_over_subscription_ratio = 20.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] message_reap_interval = 86400 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] message_ttl = 2592000 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] migration_create_volume_timeout_secs = 300 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] monkey_patch = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] monkey_patch_modules = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] my_ip = 10.0.0.210 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] no_snapshot_gb_quota = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] num_iser_scan_tries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] num_shell_tries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] num_volume_device_scan_tries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] nvmeof_conn_info_version = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] nvmet_ns_id = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] nvmet_port_id = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] osapi_max_limit = 1000 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] osapi_volume_ext_list = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] osapi_volume_listen_port = 8776 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] osapi_volume_use_ssl = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] osapi_volume_workers = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] per_volume_size_limit = -1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] periodic_fuzzy_delay = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] periodic_interval = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] public_endpoint = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] publish_errors = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_backup_gigabytes = 1000 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_backups = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_consistencygroups = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_gigabytes = 1000 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_groups = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_snapshots = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] quota_volumes = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] rate_limit_burst = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] rate_limit_except_level = CRITICAL {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] rate_limit_interval = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] reinit_driver_count = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] replication_device = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] report_discard_supported = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] report_interval = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] reservation_clean_interval = 86400 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] reservation_expire = 86400 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] reserved_image_namespaces = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] reserved_percentage = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] rpc_response_timeout = 120 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] run_external_periodic_tasks = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] san_hosts = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] scst_target_driver = iscsi {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] scst_target_iqn_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_down_time = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] snapshot_name_template = snapshot-%s {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] snapshot_same_host = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] split_loggers = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] ssh_hosts_key_file = /opt/stack/data/cinder/ssh_known_hosts {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] state_path = /opt/stack/data/cinder {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] storage_availability_zone = nova {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] storage_protocol = iSCSI {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] strict_ssh_host_key_policy = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] syslog_log_facility = LOG_USER {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] target_helper = lioadm {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] target_ip_address = 10.0.0.210 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] target_port = 3260 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] target_protocol = iscsi {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] target_secondary_ip_addresses = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] trace_flags = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] transport_url = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] until_refresh = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_chap_auth = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_default_quota_class = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_eventlog = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_journal = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_json = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_multipath_for_image_xfer = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_stderr = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] use_syslog = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] verify_glance_signatures = enabled {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_api_class = cinder.volume.api.API {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_backend_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_clear = zero {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_clear_ionice = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_clear_size = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_copy_bps_limit = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_dd_blocksize = 1M {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_name_template = volume-%s {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_service_inithost_offload = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volume_usage_audit_period = month {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] watch_log_file = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] zoning_mode = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_concurrency.disable_process_locking = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.admin_password = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.admin_token = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.admin_user = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_port = 35357 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_protocol = https {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_section = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_type = password {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_uri = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.auth_version = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.cache = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.certfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.identity_uri = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.include_service_catalog = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.insecure = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.interface = public {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.keyfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.region_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.service_type = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.backend = dogpile.cache.null {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.backend_argument = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.config_prefix = cache.oslo {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.dead_timeout = 60.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.debug_cache_backend = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.enable_retry_client = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.enable_socket_keepalive = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.enabled = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.expiration_time = 600 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.hashclient_retry_attempts = 2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.hashclient_retry_delay = 1.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_dead_retry = 300 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_password = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_pool_maxsize = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_sasl_enabled = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_socket_timeout = 1.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.memcache_username = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.proxies = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.retry_attempts = 2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.retry_delay = 0.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.socket_keepalive_count = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.socket_keepalive_idle = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.socket_keepalive_interval = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.tls_allowed_ciphers = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.tls_cafile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.tls_certfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.tls_enabled = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cache.tls_keyfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] coordination.backend_url = etcd3+http://10.0.0.210:2379 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.backend = sqlalchemy {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.connection = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.connection_debug = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.connection_parameters = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.connection_recycle_time = 3600 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.connection_trace = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.db_inc_retry_interval = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.db_max_retries = 20 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.db_max_retry_interval = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.db_retry_interval = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.max_overflow = 50 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.max_pool_size = 5 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.max_retries = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.mysql_enable_ndb = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.mysql_wsrep_sync_wait = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.pool_timeout = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.retry_interval = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.slave_connection = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.sqlite_synchronous = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] database.use_db_reconnect = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.enforce_new_defaults = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.enforce_scope = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.policy_default_rule = default {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.policy_file = policy.yaml {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.connection_string = messaging:// {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.enabled = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.es_doc_type = notification {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.es_scroll_size = 10000 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.es_scroll_time = 2m {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.filter_error_trace = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.hmac_keys = SECRET_KEY {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.sentinel_service_name = mymaster {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.socket_timeout = 0.1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] profiler.trace_sqlalchemy = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] privsep_osbrick.capabilities = [21] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] privsep_osbrick.group = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] privsep_osbrick.helper_command = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] privsep_osbrick.user = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_sys_admin.group = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_sys_admin.helper_command = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_sys_admin.thread_pool_size = 12 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] cinder_sys_admin.user = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.auth_section = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.auth_type = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.cafile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.certfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.collect_timing = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.insecure = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.keyfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.send_service_user_token = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.split_loggers = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] service_user.timeout = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.backend_availability_zone = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.chap_password = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.chap_username = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.driver_client_cert = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.driver_client_cert_key = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.driver_data_namespace = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.driver_use_ssl = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.extra_capabilities = {} {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.filter_function = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.goodness_function = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iscsi_iotype = fileio {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iscsi_target_flags = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iscsi_write_cache = on {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iser_helper = tgtadm {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iser_ip_address = 10.0.0.210 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iser_port = 3260 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.num_shell_tries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.replication_device = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.report_discard_supported = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.reserved_percentage = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_api_port = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_clustername = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_ip = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_is_local = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_login = admin {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_password = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_private_key = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_ssh_port = 22 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.san_thin_provision = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.ssh_conn_timeout = 30 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.ssh_max_pool_conn = 5 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.ssh_min_pool_conn = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.target_helper = tgtadm {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.target_ip_address = 10.0.0.210 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.target_port = 3260 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.target_protocol = iscsi {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.trace_flags = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.unique_fqdn_network = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.use_chap_auth = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_backend_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_clear = zero {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_clear_ionice = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_clear_size = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_reports.file_event_handler = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_reports.log_dir = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.backend_availability_zone = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.backend_host = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.backend_native_threads_pool_size = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.backup_use_temp_snapshot = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.chap_password = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.chap_username = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.chiscsi_conf = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.driver_client_cert = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.driver_client_cert_key = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.driver_data_namespace = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.driver_ssl_cert_path = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.driver_ssl_cert_verify = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.driver_use_ssl = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.enable_unsupported_driver = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.enforce_multipath_for_image_xfer = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.extra_capabilities = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.filter_function = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.goodness_function = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iet_conf = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.image_upload_use_cinder_backend = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.image_upload_use_internal_tenant = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.image_volume_cache_enabled = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.image_volume_cache_max_count = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.image_volume_cache_max_size_gb = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iscsi_iotype = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iscsi_target_flags = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iscsi_write_cache = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iser_helper = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iser_ip_address = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iser_port = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.iser_target_prefix = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.max_over_subscription_ratio = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.num_iser_scan_tries = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.num_shell_tries = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.num_volume_device_scan_tries = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.nvmeof_conn_info_version = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.nvmet_ns_id = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.nvmet_port_id = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.replication_device = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.report_discard_supported = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.reserved_percentage = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.scst_target_driver = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.scst_target_iqn_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.storage_protocol = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.suppress_requests_ssl_warnings = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.target_helper = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.target_ip_address = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.target_port = 3260 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.target_prefix = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.target_protocol = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.target_secondary_ip_addresses = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.trace_flags = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.unique_fqdn_network = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.use_chap_auth = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.use_multipath_for_image_xfer = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_backend_name = joviandss-2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_clear = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_clear_ionice = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_clear_size = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_copy_blkio_cgroup_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_copy_bps_limit = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_dd_blocksize = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volume_driver = cinder.volume.drivers.open_e.iscsi.JovianISCSIDriver {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] joviandss-2.volumes_dir = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.ssl = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_notifications.driver = [] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_notifications.retry = -1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] key_manager.fixed_key = **** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.barbican_api_version = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.barbican_endpoint = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.barbican_endpoint_type = public {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.barbican_region_name = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.cafile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.certfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.collect_timing = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.insecure = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.keyfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.number_of_retries = 60 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.retry_delay = 1 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.send_service_user_token = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.split_loggers = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.timeout = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.verify_ssl = True {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican.verify_ssl_path = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.auth_section = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.auth_type = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.cafile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.certfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.collect_timing = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.insecure = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.keyfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.split_loggers = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] barbican_service_user.timeout = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.approle_role_id = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.approle_secret_id = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.cafile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.certfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.collect_timing = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.insecure = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.keyfile = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.kv_mountpoint = secret {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.kv_version = 2 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.namespace = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.root_token_id = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.split_loggers = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.ssl_ca_crt_file = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.timeout = None {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.use_ssl = False {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:36:42 user cinder-volume[73480]: DEBUG oslo_service.service [None req-cdedb18e-87bc-401c-9a05-080195759d45 None None] ******************************************************************************** {{(pid=73480) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 01:36:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331795456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:36:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] check pool {{(pid=73579) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 01:36:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:36:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:36:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331795456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:36:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:36:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:36:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:36:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331795456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:36:44 user cinder-volume[73579]: INFO cinder.volume.driver [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Driver hasn't implemented _init_vendor_properties() Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Initialized capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73579) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:832}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG oslo_db.sqlalchemy.engines [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73579) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writer thread running {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.db.sqlalchemy.api [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Building query based on filter {{(pid=73579) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73579) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1146}} Apr 14 01:36:44 user cinder-volume[73579]: INFO cinder.keymgr.migration [None req-6e27eb08-fee3-42b9-bb30-c92e9ba5b3ea None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331795456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.manager [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:36:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Driver initialization completed successfully. Apr 14 01:36:44 user cinder-volume[73579]: INFO cinder.manager [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Initiating service 2 cleanup Apr 14 01:36:44 user cinder-volume[73579]: INFO cinder.manager [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Service 2 cleanup completed. Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.service [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Creating RPC server for service cinder-volume {{(pid=73579) start /opt/stack/cinder/cinder/service.py:238}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.service [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73579) start /opt/stack/cinder/cinder/service.py:244}} Apr 14 01:36:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Initializing RPC dependent components of volume driver JovianISCSIDriver (1.0.2) Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:36:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:36:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331795456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:36:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:36:45 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fd1b93bd-3db4-4230-acb7-16dadf6ecb0d None None] Driver post RPC initialization completed successfully. Apr 14 01:36:52 user cinder-volume[73480]: DEBUG dbcounter [-] [73480] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=73480) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=23,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:37:15 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:37:25 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:37:45 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:37:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:38:15 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:38:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:38:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:38:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:38:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:38:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:38:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331795456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:38:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:38:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:38:35 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:38:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:38:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:39:05 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:39:15 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:39:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:39:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:39:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:39:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:39:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:39:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331807744', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:39:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:39:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:39:35 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:39:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:05 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Flow 'volume_create_manager' (83e34f43-ee6f-4651-ba2e-2f67ab01b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3137dd75-090e-4f9c-97ec-309de0e6328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3137dd75-090e-4f9c-97ec-309de0e6328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1829426363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=afc64947-1680-4abe-b35b-5ba1acebbd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd81ae5fd4394e8fb708d5ed2f49cc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:20Z,use_quota=True,user_id='20b8062e50d14a24a336de767550fdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac69dcb5-9bfe-4689-bfd5-d901292d68d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac69dcb5-9bfe-4689-bfd5-d901292d68d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045e4f57-5d00-4a7d-9dd7-b2faf8f381a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045e4f57-5d00-4a7d-9dd7-b2faf8f381a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc64947-1680-4abe-b35b-5ba1acebbd76', 'volume_name': 'volume-afc64947-1680-4abe-b35b-5ba1acebbd76', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c58203e-17c1-408a-921b-8283a03421de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c58203e-17c1-408a-921b-8283a03421de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e27ff56-ff8b-4774-931f-0811d0a3c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:20 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Volume afc64947-1680-4abe-b35b-5ba1acebbd76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc64947-1680-4abe-b35b-5ba1acebbd76', 'volume_size': 1} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] creating volume v_afc64947-1680-4abe-b35b-5ba1acebbd76. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] create volume {'name': 'v_afc64947-1680-4abe-b35b-5ba1acebbd76', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5cff6d5d-dd15-4838-82aa-5ff5bcbde1eb tempest-GroupsV314Test-1954759616 None] Group tempest-GroupsV314Test-Group-1602459331: creating Apr 14 01:40:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5cff6d5d-dd15-4838-82aa-5ff5bcbde1eb tempest-GroupsV314Test-1954759616 None] Group tempest-GroupsV314Test-Group-1602459331: created successfully Apr 14 01:40:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5cff6d5d-dd15-4838-82aa-5ff5bcbde1eb tempest-GroupsV314Test-1954759616 None] Create group completed successfully. Apr 14 01:40:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_afc64947-1680-4abe-b35b-5ba1acebbd76', 'is_clone': False, 'name': 'v_afc64947-1680-4abe-b35b-5ba1acebbd76'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e27ff56-ff8b-4774-931f-0811d0a3c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc64947-1680-4abe-b35b-5ba1acebbd76', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58438881-fbf0-4d28-adad-625cc0b1e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:21 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Volume volume-afc64947-1680-4abe-b35b-5ba1acebbd76 (afc64947-1680-4abe-b35b-5ba1acebbd76): created successfully Apr 14 01:40:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58438881-fbf0-4d28-adad-625cc0b1e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Flow 'volume_create_manager' (83e34f43-ee6f-4651-ba2e-2f67ab01b435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:21 user cinder-volume[73579]: INFO cinder.volume.manager [req-3d928981-35bf-46a5-b392-ab68e5098765 req-03801026-4ee6-4493-9830-f51424ecd0f3 tempest-VolumesSnapshotsTestJSON-1111151513 None] Created volume successfully. Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Flow 'volume_create_manager' (8463bf87-fb0f-4fc5-a9a9-72a3c819e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef77dbb-85bc-4f84-9c7b-ca4aba7cda57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef77dbb-85bc-4f84-9c7b-ca4aba7cda57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2106817139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=479faa46-c520-4935-9a60-c1b68e79f77b,host='user@joviandss-2#joviandss-2',id=dbe1c852-abbe-4633-8f13-f3ae1d879486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d51a9c35584d119307ea445806f65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:22Z,use_quota=True,user_id='40f36b0287d6447c9eaf22bddc084f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b653ada4-ed33-4de9-bced-810833ad781b),volume_type_id=b653ada4-ed33-4de9-bced-810833ad781b)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5881d6-36ef-4eb5-8f56-c06111881196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5881d6-36ef-4eb5-8f56-c06111881196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9d89b0-d210-45bb-8225-88c97fffd5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9d89b0-d210-45bb-8225-88c97fffd5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe1c852-abbe-4633-8f13-f3ae1d879486', 'volume_name': 'volume-dbe1c852-abbe-4633-8f13-f3ae1d879486', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6369ff00-c5ef-4842-97d6-272ce8adfb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6369ff00-c5ef-4842-97d6-272ce8adfb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339e41bc-25c9-4c12-af3c-c41180c26c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:22 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Volume dbe1c852-abbe-4633-8f13-f3ae1d879486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe1c852-abbe-4633-8f13-f3ae1d879486', 'volume_size': 1} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] creating volume v_dbe1c852-abbe-4633-8f13-f3ae1d879486. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] create volume {'name': 'v_dbe1c852-abbe-4633-8f13-f3ae1d879486', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] create snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 for volume afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] cloning v_afc64947-1680-4abe-b35b-5ba1acebbd76 to s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] create snapshot s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_dbe1c852-abbe-4633-8f13-f3ae1d879486', 'is_clone': False, 'name': 'v_dbe1c852-abbe-4633-8f13-f3ae1d879486'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339e41bc-25c9-4c12-af3c-c41180c26c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe1c852-abbe-4633-8f13-f3ae1d879486', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d409d9-184c-4bd3-91a4-34fd8f146cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Volume volume-dbe1c852-abbe-4633-8f13-f3ae1d879486 (dbe1c852-abbe-4633-8f13-f3ae1d879486): created successfully Apr 14 01:40:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d409d9-184c-4bd3-91a4-34fd8f146cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Flow 'volume_create_manager' (8463bf87-fb0f-4fc5-a9a9-72a3c819e79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:23 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8b47d087-dc02-4635-8508-ad6c3e02d4ef tempest-GroupsV314Test-1954759616 None] Created volume successfully. Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_8906ce85-d2ea-4c42-aed2-806d97ba71d5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] create volume s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 from snapshot s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] cloned volume dbe1c852-abbe-4633-8f13-f3ae1d879486 to 4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] cloning v_dbe1c852-abbe-4633-8f13-f3ae1d879486 to v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] create snapshot v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_afc64947-1680-4abe-b35b-5ba1acebbd76@s_8906ce85-d2ea-4c42-aed2-806d97ba71d5', 'is_clone': True, 'full_name': 'Pool-0/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5', 'name': 's_8906ce85-d2ea-4c42-aed2-806d97ba71d5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:25 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=27,cinder:UPDATE=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_4d5686e4-87fd-40ea-bda0-eb9b813791bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] create volume v_4d5686e4-87fd-40ea-bda0-eb9b813791bf from snapshot v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:40:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] volume s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:40:26 user cinder-volume[73579]: INFO cinder.volume.manager [req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf req-4d3ebc3e-4123-4e01-8ae6-d7b78f39adf0 tempest-VolumesSnapshotsTestJSON-1111151513 None] Create snapshot completed successfully Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_dbe1c852-abbe-4633-8f13-f3ae1d879486@v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'is_clone': True, 'full_name': 'Pool-0/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'name': 'v_4d5686e4-87fd-40ea-bda0-eb9b813791bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] get volume v_4d5686e4-87fd-40ea-bda0-eb9b813791bf info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_dbe1c852-abbe-4633-8f13-f3ae1d879486@v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437835', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110156', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17024902228650195626', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2261d64b543f4b33', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331631616', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81715', 'name': 'v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.coordination [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Acquiring lock "cinder-8906ce85-d2ea-4c42-aed2-806d97ba71d5-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.coordination [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Lock "cinder-8906ce85-d2ea-4c42-aed2-806d97ba71d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] deleating snapshot s_8906ce85-d2ea-4c42-aed2-806d97ba71d5. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] get snapshots for volume s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-583b006f-5287-46ee-91c7-f60e5de78f52 tempest-GroupsV314Test-1954759616 None] Create group from source-group-479faa46-c520-4935-9a60-c1b68e79f77b completed successfully. Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] get volume s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_afc64947-1680-4abe-b35b-5ba1acebbd76@s_8906ce85-d2ea-4c42-aed2-806d97ba71d5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437833', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110150', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14139072328156381064', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd8b18d0710e8a526', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331619328', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81699', 'name': 's_8906ce85-d2ea-4c42-aed2-806d97ba71d5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] delete snapshot s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 of volume v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] remove_export for volume: 4d5686e4-87fd-40ea-bda0-eb9b813791bf. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75cd0938-8f47-4250-b1e4-eac950eff0ca,host='user@joviandss-2#joviandss-2',id=4d5686e4-87fd-40ea-bda0-eb9b813791bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d51a9c35584d119307ea445806f65d',provider_auth='CHAP zomnFlgR NuxLmwihDGWsK5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dbe1c852-abbe-4633-8f13-f3ae1d879486,status='deleting',terminated_at=None,updated_at=2023-04-14T01:40:28Z,use_quota=True,user_id='40f36b0287d6447c9eaf22bddc084f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b653ada4-ed33-4de9-bced-810833ad781b),volume_type_id=b653ada4-ed33-4de9-bced-810833ad781b) from target:iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] detach volume v_4d5686e4-87fd-40ea-bda0-eb9b813791bf from target iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf/luns/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf/luns/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots/s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] snapshot s_8906ce85-d2ea-4c42-aed2-806d97ba71d5 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf/luns/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf/luns/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] failed to remove resource iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf because of JDSS resource v_4d5686e4-87fd-40ea-bda0-eb9b813791bf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] delete target: iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] delete target iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] failed to remove resource iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf because of JDSS resource iqn.2010-10.org.openstack:4d5686e4-87fd-40ea-bda0-eb9b813791bf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] deleating volume v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] get snapshots for volume v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:29 user cinder-volume[73579]: WARNING cinder.quota [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Deprecated: Default quota for resource: gigabytes_joviandss-2 is set by the default quota flag: quota_gigabytes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:40:29 user cinder-volume[73579]: WARNING cinder.quota [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Deprecated: Default quota for resource: snapshots_joviandss-2 is set by the default quota flag: quota_snapshots_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.quota [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Created reservations ['7ffabbe1-0c82-4b8d-a7c0-534c0a240f5d', 'cabcb406-fe95-48bf-baae-4283dc84cda6', '2ad2adf4-0136-4cb1-b902-1355037b1ea3', '2b9314e1-4322-4296-b534-3fb1e80f2c16'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:29 user cinder-volume[73579]: INFO cinder.volume.manager [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Delete snapshot completed successfully. Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.coordination [req-16dc3858-96a2-46c3-9d96-73970eeaed24 req-974c87bd-ae59-4049-914d-eb2f21959c2f tempest-VolumesSnapshotsTestJSON-1111151513 None] Lock "cinder-8906ce85-d2ea-4c42-aed2-806d97ba71d5-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] get volume v_4d5686e4-87fd-40ea-bda0-eb9b813791bf info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_dbe1c852-abbe-4633-8f13-f3ae1d879486@v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437835', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110156', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17024902228650195626', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2261d64b543f4b33', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331631616', 'san:volume_id': '2261d64b543f4b33dd05f571e2982b2024af8307', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81715', 'name': 'v_4d5686e4-87fd-40ea-bda0-eb9b813791bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] delete snapshot v_4d5686e4-87fd-40ea-bda0-eb9b813791bf of volume v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.coordination [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Acquiring lock "cinder-afc64947-1680-4abe-b35b-5ba1acebbd76-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.coordination [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Lock "cinder-afc64947-1680-4abe-b35b-5ba1acebbd76-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] remove_export for volume: afc64947-1680-4abe-b35b-5ba1acebbd76. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1829426363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=afc64947-1680-4abe-b35b-5ba1acebbd76,launched_at=2023-04-14T01:40:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd81ae5fd4394e8fb708d5ed2f49cc92',provider_auth='CHAP ErefTcjk 9WpQPJiwZAfoa6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:20Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:40:30Z,updated_at=2023-04-14T01:40:30Z,use_quota=True,user_id='20b8062e50d14a24a336de767550fdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] detach volume v_afc64947-1680-4abe-b35b-5ba1acebbd76 from target iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76/luns/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76/luns/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots/v_4d5686e4-87fd-40ea-bda0-eb9b813791bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] snapshot v_4d5686e4-87fd-40ea-bda0-eb9b813791bf deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76/luns/v_afc64947-1680-4abe-b35b-5ba1acebbd76'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76/luns/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] failed to remove resource iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 because of JDSS resource v_afc64947-1680-4abe-b35b-5ba1acebbd76 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] delete target: iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] delete target iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] failed to remove resource iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 because of JDSS resource iqn.2010-10.org.openstack:afc64947-1680-4abe-b35b-5ba1acebbd76 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] deleating volume v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] get snapshots for volume v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.quota [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Created reservations ['e4b96476-f637-49f7-aa65-73e388879ceb'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:31 user cinder-volume[73579]: WARNING cinder.quota [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-437420962 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-437420962, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:40:31 user cinder-volume[73579]: WARNING cinder.quota [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-437420962 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-437420962, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.quota [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Created reservations ['358270fd-c6da-4498-9151-a3f86467dbb5', '8d00c5ad-1b9b-4fde-bb14-59b8097bfdbf', 'cda5db3a-a7de-42c0-899a-0db986fe440d', '57d2c32f-f82b-4794-9207-b5b32ad7c36c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331656192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] get volume v_afc64947-1680-4abe-b35b-5ba1acebbd76 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_afc64947-1680-4abe-b35b-5ba1acebbd76', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437830', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110140', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4602216680885975030', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9b1efa618e6f803d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331656192', 'san:volume_id': '9b1efa618e6f803dd0f4645bf91324fae73e15d5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81677', 'name': 'v_afc64947-1680-4abe-b35b-5ba1acebbd76', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] delete volume:v_afc64947-1680-4abe-b35b-5ba1acebbd76 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331656192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.manager [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:32 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9ce5e461-ab9c-409f-92b1-03cc4721f1ad tempest-GroupsV314Test-1954759616 None] Delete group completed successfully. Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] remove_export for volume: dbe1c852-abbe-4633-8f13-f3ae1d879486. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2106817139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=479faa46-c520-4935-9a60-c1b68e79f77b,host='user@joviandss-2#joviandss-2',id=dbe1c852-abbe-4633-8f13-f3ae1d879486,launched_at=2023-04-14T01:40:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d51a9c35584d119307ea445806f65d',provider_auth='CHAP HKcknJLp ZDasP9o6u5krT7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:22Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T01:40:33Z,use_quota=True,user_id='40f36b0287d6447c9eaf22bddc084f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b653ada4-ed33-4de9-bced-810833ad781b),volume_type_id=b653ada4-ed33-4de9-bced-810833ad781b) from target:iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] detach volume v_dbe1c852-abbe-4633-8f13-f3ae1d879486 from target iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486/luns/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486/luns/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486/luns/v_dbe1c852-abbe-4633-8f13-f3ae1d879486'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486/luns/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] failed to remove resource iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 because of JDSS resource v_dbe1c852-abbe-4633-8f13-f3ae1d879486 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] delete target: iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] delete target iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] failed to remove resource iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 because of JDSS resource iqn.2010-10.org.openstack:dbe1c852-abbe-4633-8f13-f3ae1d879486 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] deleating volume v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] get snapshots for volume v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] get volume v_dbe1c852-abbe-4633-8f13-f3ae1d879486 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_dbe1c852-abbe-4633-8f13-f3ae1d879486', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437832', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110144', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13454818939256418657', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '247d9b414c245a7e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331738112', 'san:volume_id': '247d9b414c245a7e25c560f835bb184e6bf1284d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81686', 'name': 'v_dbe1c852-abbe-4633-8f13-f3ae1d879486', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] delete volume:v_dbe1c852-abbe-4633-8f13-f3ae1d879486 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:35 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=59,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_afc64947-1680-4abe-b35b-5ba1acebbd76 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] volume v_afc64947-1680-4abe-b35b-5ba1acebbd76 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:40:36 user cinder-volume[73579]: WARNING cinder.quota [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Deprecated: Default quota for resource: volumes_joviandss-2 is set by the default quota flag: quota_volumes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:40:36 user cinder-volume[73579]: DEBUG cinder.quota [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Created reservations ['e416afe2-f6e6-4780-a2ae-f55eb446a4b3', '64b783f1-938c-4a71-a9c1-e42eb264cdca', '45e281a7-09db-4790-9ef4-90b836295095', '28f56128-fb67-4f70-bd7a-d07a9a9509d6'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331820032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:37 user cinder-volume[73579]: DEBUG cinder.manager [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:37 user cinder-volume[73579]: INFO cinder.volume.manager [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Deleted volume successfully. Apr 14 01:40:37 user cinder-volume[73579]: DEBUG cinder.coordination [req-444bcfd4-0265-4af6-9c18-466e1dffdc85 req-a94abf01-f4e6-4960-8a16-7e3f01c21ba5 tempest-VolumesSnapshotsTestJSON-1111151513 None] Lock "cinder-afc64947-1680-4abe-b35b-5ba1acebbd76-delete_volume" released by "delete_volume" :: held 6.769s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dbe1c852-abbe-4633-8f13-f3ae1d879486 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] volume v_dbe1c852-abbe-4633-8f13-f3ae1d879486 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.quota [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Created reservations ['c2acb923-ef86-42c4-ac66-62769ac9cdbd'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.quota [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Created reservations ['5b9eef16-0d6d-407f-a189-295b10f8669f', '90317e71-bcfe-45b2-97f2-78f0e47a1085', '61e74f0b-ad68-427f-addd-adbc6544d315', '0b4a9dd4-8290-4611-b91a-c1c086e62d28'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=63,cinder:INSERT=9,cinder:UPDATE=28 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Flow 'volume_create_manager' (e72f1efc-88f5-4cfc-8974-aca5c94e0da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a497b112-8a18-4d6d-a974-1bd203996fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a497b112-8a18-4d6d-a974-1bd203996fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-944163897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f753d550-47e5-448b-a691-05272b68c90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b504067d295d4815ac548e95dd1c606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:39Z,use_quota=True,user_id='0086c37a3362491097b76d84f163fef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caebb358-9e35-4d09-9088-331453bdd512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caebb358-9e35-4d09-9088-331453bdd512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9a8239-0848-404b-8056-258cba83dd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9a8239-0848-404b-8056-258cba83dd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f753d550-47e5-448b-a691-05272b68c90c', 'volume_name': 'volume-f753d550-47e5-448b-a691-05272b68c90c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b03dc24-8aa7-4e54-a43b-34f866c09dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b03dc24-8aa7-4e54-a43b-34f866c09dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae14390-2c65-4825-9d88-15f333e03823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:39 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Volume f753d550-47e5-448b-a691-05272b68c90c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f753d550-47e5-448b-a691-05272b68c90c', 'volume_size': 1} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] creating volume v_f753d550-47e5-448b-a691-05272b68c90c. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] create volume {'name': 'v_f753d550-47e5-448b-a691-05272b68c90c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331820032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:39 user cinder-volume[73579]: DEBUG cinder.manager [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:39 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e6f18cbf-4780-4540-8cf0-b785b309afe1 tempest-GroupsV314Test-1954759616 None] Delete group completed successfully. Apr 14 01:40:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f753d550-47e5-448b-a691-05272b68c90c', 'is_clone': False, 'name': 'v_f753d550-47e5-448b-a691-05272b68c90c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae14390-2c65-4825-9d88-15f333e03823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f753d550-47e5-448b-a691-05272b68c90c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5ab8a6-0175-4c75-be2d-5ec08693c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:40 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Volume volume-f753d550-47e5-448b-a691-05272b68c90c (f753d550-47e5-448b-a691-05272b68c90c): created successfully Apr 14 01:40:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5ab8a6-0175-4c75-be2d-5ec08693c39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Flow 'volume_create_manager' (e72f1efc-88f5-4cfc-8974-aca5c94e0da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2bc2d4bd-768c-4436-90e6-141e8e86b909 tempest-SnapshotMetadataTestJSON-98283123 None] Created volume successfully. Apr 14 01:40:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] create snapshot e0545903-f1f5-41af-a490-f1dcac8bcae0 for volume f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:40:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] cloning v_f753d550-47e5-448b-a691-05272b68c90c to s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:40:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] create snapshot s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:40:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e0545903-f1f5-41af-a490-f1dcac8bcae0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] create volume s_e0545903-f1f5-41af-a490-f1dcac8bcae0 from snapshot s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Flow 'volume_create_manager' (76997476-5b2e-468c-8794-2ee331ccd6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83979d2-279d-47e8-839e-a8bdd6cecf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83979d2-279d-47e8-839e-a8bdd6cecf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555509389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6448ba63-3837-41ef-bb75-176c1562f669,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='796f89d4b8524e30b60b1a23b5873486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:43Z,use_quota=True,user_id='cb374a2b129a43d498365a50bd0bf59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c0544c-9a58-4cd5-ba19-4463288051c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c0544c-9a58-4cd5-ba19-4463288051c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968f506f-2e7a-4fd6-b72a-a945ed4d0b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968f506f-2e7a-4fd6-b72a-a945ed4d0b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6448ba63-3837-41ef-bb75-176c1562f669', 'volume_name': 'volume-6448ba63-3837-41ef-bb75-176c1562f669', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad7e4e-83b7-43e0-8c68-d9f4caab10c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad7e4e-83b7-43e0-8c68-d9f4caab10c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44eae23-ab25-40d8-9c2e-77644d009770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:42 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Volume 6448ba63-3837-41ef-bb75-176c1562f669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6448ba63-3837-41ef-bb75-176c1562f669', 'volume_size': 1} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] creating volume v_6448ba63-3837-41ef-bb75-176c1562f669. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] create volume {'name': 'v_6448ba63-3837-41ef-bb75-176c1562f669', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f753d550-47e5-448b-a691-05272b68c90c@s_e0545903-f1f5-41af-a490-f1dcac8bcae0', 'is_clone': True, 'full_name': 'Pool-0/s_e0545903-f1f5-41af-a490-f1dcac8bcae0', 'name': 's_e0545903-f1f5-41af-a490-f1dcac8bcae0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] volume s_e0545903-f1f5-41af-a490-f1dcac8bcae0 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:40:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-098e7b61-d14c-46a2-a80d-40fbc020db34 tempest-SnapshotMetadataTestJSON-98283123 None] Create snapshot completed successfully Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6448ba63-3837-41ef-bb75-176c1562f669', 'is_clone': False, 'name': 'v_6448ba63-3837-41ef-bb75-176c1562f669'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44eae23-ab25-40d8-9c2e-77644d009770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6448ba63-3837-41ef-bb75-176c1562f669', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c806d329-7d86-4713-86fb-45fe4bbb91d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Volume volume-6448ba63-3837-41ef-bb75-176c1562f669 (6448ba63-3837-41ef-bb75-176c1562f669): created successfully Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c806d329-7d86-4713-86fb-45fe4bbb91d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Flow 'volume_create_manager' (76997476-5b2e-468c-8794-2ee331ccd6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9f0908bb-ebdc-4834-9ca6-5bded1f4c961 tempest-VolumesTestJSON-581132467 None] Created volume successfully. Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Acquiring lock "cinder-e0545903-f1f5-41af-a490-f1dcac8bcae0-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Lock "cinder-e0545903-f1f5-41af-a490-f1dcac8bcae0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] deleating snapshot s_e0545903-f1f5-41af-a490-f1dcac8bcae0. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] get snapshots for volume s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] get volume s_e0545903-f1f5-41af-a490-f1dcac8bcae0 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f753d550-47e5-448b-a691-05272b68c90c@s_e0545903-f1f5-41af-a490-f1dcac8bcae0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e0545903-f1f5-41af-a490-f1dcac8bcae0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437851', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110175', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2611661027053796285', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b6c60d50bbf17529', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331631616', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81315', 'name': 's_e0545903-f1f5-41af-a490-f1dcac8bcae0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] delete snapshot s_e0545903-f1f5-41af-a490-f1dcac8bcae0 of volume v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots/s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots/s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Flow 'volume_create_manager' (7b5cf15f-3e04-4df2-b21e-eb7a353703d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7655839e-73bc-45a2-b17c-4b3f4865826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7655839e-73bc-45a2-b17c-4b3f4865826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-65836439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=133f3844-7bc4-4bce-88c9-de5fb01dd86c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='796f89d4b8524e30b60b1a23b5873486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:45Z,use_quota=True,user_id='cb374a2b129a43d498365a50bd0bf59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c60097-3ff1-409f-bae8-903d5cde4a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c60097-3ff1-409f-bae8-903d5cde4a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97d4fbe-80c2-4e55-b2e0-7c335fa48f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97d4fbe-80c2-4e55-b2e0-7c335fa48f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'volume_name': 'volume-133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01795414-e44f-4d91-8f87-ac81453df47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01795414-e44f-4d91-8f87-ac81453df47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58d4d37-6dd6-48a5-8b9a-62343a4b2980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:45 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Volume 133f3844-7bc4-4bce-88c9-de5fb01dd86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'volume_size': 1} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] creating volume v_133f3844-7bc4-4bce-88c9-de5fb01dd86c. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] create volume {'name': 'v_133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'is_clone': False, 'name': 'v_133f3844-7bc4-4bce-88c9-de5fb01dd86c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58d4d37-6dd6-48a5-8b9a-62343a4b2980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca200eb1-afb8-46e1-9cf0-ef1484e3a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:45 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Volume volume-133f3844-7bc4-4bce-88c9-de5fb01dd86c (133f3844-7bc4-4bce-88c9-de5fb01dd86c): created successfully Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca200eb1-afb8-46e1-9cf0-ef1484e3a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Flow 'volume_create_manager' (7b5cf15f-3e04-4df2-b21e-eb7a353703d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:45 user cinder-volume[73579]: INFO cinder.volume.manager [None req-856a0b24-34b2-49d6-bf2e-dd4cc54360de tempest-VolumesTestJSON-581132467 None] Created volume successfully. Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Flow 'volume_create_manager' (982e50f6-4c70-42ca-8911-bbc15926e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63b663b-220b-4aeb-9063-2ef8dcc21d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63b663b-220b-4aeb-9063-2ef8dcc21d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-481074662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=61190ed3-dd15-4a87-84fb-99edfb2d8008,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='796f89d4b8524e30b60b1a23b5873486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:46Z,use_quota=True,user_id='cb374a2b129a43d498365a50bd0bf59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17284b1-1b7f-4bdb-b2df-b5109ca583f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17284b1-1b7f-4bdb-b2df-b5109ca583f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa02b267-a8d6-4740-8b47-c652c17f6a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa02b267-a8d6-4740-8b47-c652c17f6a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61190ed3-dd15-4a87-84fb-99edfb2d8008', 'volume_name': 'volume-61190ed3-dd15-4a87-84fb-99edfb2d8008', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f40d13-a0fb-44dd-9162-4bccf3138a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f40d13-a0fb-44dd-9162-4bccf3138a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76516315-a9c9-4976-bee7-f368d8078c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:46 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Volume 61190ed3-dd15-4a87-84fb-99edfb2d8008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61190ed3-dd15-4a87-84fb-99edfb2d8008', 'volume_size': 1} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] creating volume v_61190ed3-dd15-4a87-84fb-99edfb2d8008. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] create volume {'name': 'v_61190ed3-dd15-4a87-84fb-99edfb2d8008', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots/s_e0545903-f1f5-41af-a490-f1dcac8bcae0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] snapshot s_e0545903-f1f5-41af-a490-f1dcac8bcae0 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.quota [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Created reservations ['6facce83-fc67-4449-8b75-27fc374278d9', 'e8386319-218b-4512-9e5b-e7c16a9ab98d', 'fd346f59-f4c3-4d93-bb3e-d79abdc0d58e', '3254f75f-17da-4c3b-b746-47a386c7b7b6'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Delete snapshot completed successfully. Apr 14 01:40:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c7d9914c-e563-4f00-a336-b35f27fb2ceb tempest-SnapshotMetadataTestJSON-98283123 None] Lock "cinder-e0545903-f1f5-41af-a490-f1dcac8bcae0-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_61190ed3-dd15-4a87-84fb-99edfb2d8008', 'is_clone': False, 'name': 'v_61190ed3-dd15-4a87-84fb-99edfb2d8008'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=56,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76516315-a9c9-4976-bee7-f368d8078c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61190ed3-dd15-4a87-84fb-99edfb2d8008', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afad281-4995-431b-bf98-88e2b36863ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:47 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Volume volume-61190ed3-dd15-4a87-84fb-99edfb2d8008 (61190ed3-dd15-4a87-84fb-99edfb2d8008): created successfully Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afad281-4995-431b-bf98-88e2b36863ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Flow 'volume_create_manager' (982e50f6-4c70-42ca-8911-bbc15926e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:47 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fae79b33-d8a9-4c57-882a-f1628647ba3e tempest-VolumesTestJSON-581132467 None] Created volume successfully. Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Acquiring lock "cinder-f753d550-47e5-448b-a691-05272b68c90c-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Lock "cinder-f753d550-47e5-448b-a691-05272b68c90c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] remove_export for volume: f753d550-47e5-448b-a691-05272b68c90c. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-944163897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f753d550-47e5-448b-a691-05272b68c90c,launched_at=2023-04-14T01:40:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b504067d295d4815ac548e95dd1c606c',provider_auth='CHAP DChQMrgL ZmlkVF6q7dAoSQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:39Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:40:48Z,updated_at=2023-04-14T01:40:48Z,use_quota=True,user_id='0086c37a3362491097b76d84f163fef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] detach volume v_f753d550-47e5-448b-a691-05272b68c90c from target iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c/luns/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c/luns/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c/luns/v_f753d550-47e5-448b-a691-05272b68c90c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c/luns/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] failed to remove resource iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c because of JDSS resource v_f753d550-47e5-448b-a691-05272b68c90c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] delete target: iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] delete target iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] failed to remove resource iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c because of JDSS resource iqn.2010-10.org.openstack:f753d550-47e5-448b-a691-05272b68c90c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] deleating volume v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] get snapshots for volume v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] get volume v_f753d550-47e5-448b-a691-05272b68c90c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f753d550-47e5-448b-a691-05272b68c90c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437849', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110169', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4047837494010773821', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '21423aec6885e602', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331406336', 'san:volume_id': '21423aec6885e602764b8a83ecd77e5af55a9587', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81798', 'name': 'v_f753d550-47e5-448b-a691-05272b68c90c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] delete volume:v_f753d550-47e5-448b-a691-05272b68c90c recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Flow 'volume_create_manager' (a124f912-6cff-43fb-86b9-88d7c45ce681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9d9ff9-9477-4e71-98bb-820959454d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9d9ff9-9477-4e71-98bb-820959454d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-41714900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=060154b9-311a-4781-85d4-3b7aea6601b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f25f92099844598cc492823f2f2715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:48Z,use_quota=True,user_id='0923cd3b5fec44d4b59bd14141b60643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b3fb79-be82-4963-aa14-1fc7f492781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b3fb79-be82-4963-aa14-1fc7f492781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5920bce6-9cfe-4d07-bfb2-cec26fb043db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5920bce6-9cfe-4d07-bfb2-cec26fb043db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060154b9-311a-4781-85d4-3b7aea6601b6', 'volume_name': 'volume-060154b9-311a-4781-85d4-3b7aea6601b6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddd55aa-6a45-4308-8c34-9ab393972522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddd55aa-6a45-4308-8c34-9ab393972522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d20e800-5f78-4b65-84a9-d7e7881447eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:48 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Volume 060154b9-311a-4781-85d4-3b7aea6601b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060154b9-311a-4781-85d4-3b7aea6601b6', 'volume_size': 1} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] creating volume v_060154b9-311a-4781-85d4-3b7aea6601b6. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] create volume {'name': 'v_060154b9-311a-4781-85d4-3b7aea6601b6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_060154b9-311a-4781-85d4-3b7aea6601b6', 'is_clone': False, 'name': 'v_060154b9-311a-4781-85d4-3b7aea6601b6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d20e800-5f78-4b65-84a9-d7e7881447eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060154b9-311a-4781-85d4-3b7aea6601b6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b8fbc5-a3dc-4da7-9de1-3ae5169b6f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:49 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Volume volume-060154b9-311a-4781-85d4-3b7aea6601b6 (060154b9-311a-4781-85d4-3b7aea6601b6): created successfully Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b8fbc5-a3dc-4da7-9de1-3ae5169b6f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Flow 'volume_create_manager' (a124f912-6cff-43fb-86b9-88d7c45ce681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b20e780c-27fd-4251-957f-f0c64048c8d1 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Created volume successfully. Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.coordination [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Acquiring lock "cinder-61190ed3-dd15-4a87-84fb-99edfb2d8008-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.coordination [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Lock "cinder-61190ed3-dd15-4a87-84fb-99edfb2d8008-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] remove_export for volume: 61190ed3-dd15-4a87-84fb-99edfb2d8008. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-481074662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=61190ed3-dd15-4a87-84fb-99edfb2d8008,launched_at=2023-04-14T01:40:48Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='796f89d4b8524e30b60b1a23b5873486',provider_auth='CHAP dLFpuCeJ 28tZAeQELcslC4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:46Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:40:50Z,updated_at=2023-04-14T01:40:50Z,use_quota=True,user_id='cb374a2b129a43d498365a50bd0bf59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] detach volume v_61190ed3-dd15-4a87-84fb-99edfb2d8008 from target iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008/luns/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008/luns/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008/luns/v_61190ed3-dd15-4a87-84fb-99edfb2d8008'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008/luns/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] failed to remove resource iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 because of JDSS resource v_61190ed3-dd15-4a87-84fb-99edfb2d8008 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] delete target: iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] delete target iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] failed to remove resource iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 because of JDSS resource iqn.2010-10.org.openstack:61190ed3-dd15-4a87-84fb-99edfb2d8008 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] deleating volume v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] get snapshots for volume v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f753d550-47e5-448b-a691-05272b68c90c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] volume v_f753d550-47e5-448b-a691-05272b68c90c deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.quota [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Created reservations ['b8f273a8-ddf7-45e4-9f98-2088a0087e19', '2bb6dc71-6b15-4c11-a512-270dc4115a12', 'c12f4e95-9394-47aa-9e8d-f01f0baec180', 'e1474aeb-de22-46e6-9f86-ba05b0fbed94'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] get volume v_61190ed3-dd15-4a87-84fb-99edfb2d8008 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_61190ed3-dd15-4a87-84fb-99edfb2d8008', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437856', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110191', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4020416697852925511', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '14004ea4c25c09d0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331394048', 'san:volume_id': '14004ea4c25c09d03c967984ce98a68aba4f3309', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80240', 'name': 'v_61190ed3-dd15-4a87-84fb-99edfb2d8008', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] delete volume:v_61190ed3-dd15-4a87-84fb-99edfb2d8008 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331394048', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.manager [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Deleted volume successfully. Apr 14 01:40:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c7338ec-614d-4df4-82ab-0c5f4b51cd11 tempest-SnapshotMetadataTestJSON-98283123 None] Lock "cinder-f753d550-47e5-448b-a691-05272b68c90c-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Acquiring lock "cinder-060154b9-311a-4781-85d4-3b7aea6601b6-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Lock "cinder-060154b9-311a-4781-85d4-3b7aea6601b6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=32,cinder:SELECT=60,cinder:DELETE=3,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] remove_export for volume: 060154b9-311a-4781-85d4-3b7aea6601b6. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-41714900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=060154b9-311a-4781-85d4-3b7aea6601b6,launched_at=2023-04-14T01:40:49Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='77f25f92099844598cc492823f2f2715',provider_auth='CHAP KNBdITHX FHd8RPgWCbwBk7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:48Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:40:51Z,updated_at=2023-04-14T01:40:51Z,use_quota=True,user_id='0923cd3b5fec44d4b59bd14141b60643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] detach volume v_060154b9-311a-4781-85d4-3b7aea6601b6 from target iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6/luns/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6/luns/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6/luns/v_060154b9-311a-4781-85d4-3b7aea6601b6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6/luns/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] failed to remove resource iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 because of JDSS resource v_060154b9-311a-4781-85d4-3b7aea6601b6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] delete target: iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] delete target iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] failed to remove resource iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 because of JDSS resource iqn.2010-10.org.openstack:060154b9-311a-4781-85d4-3b7aea6601b6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] deleating volume v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] get snapshots for volume v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] get volume v_060154b9-311a-4781-85d4-3b7aea6601b6 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_060154b9-311a-4781-85d4-3b7aea6601b6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437858', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110195', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '191350730562061377', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'faf70b5dae08af5f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331488256', 'san:volume_id': 'faf70b5dae08af5ffd7612f63c44a715e31e9e88', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81828', 'name': 'v_060154b9-311a-4781-85d4-3b7aea6601b6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] delete volume:v_060154b9-311a-4781-85d4-3b7aea6601b6 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61190ed3-dd15-4a87-84fb-99edfb2d8008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] volume v_61190ed3-dd15-4a87-84fb-99edfb2d8008 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.quota [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Created reservations ['8623928d-df3c-4b62-9aef-494eee6ccff7', '566c16e4-02a9-4f2f-8f7c-af9dbb76c381', 'c8d165b6-e0a6-47f8-bbdb-e3286b65d005', '7f77f4d9-6bf3-4844-b8d2-2b3d9ac168d3'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Acquiring lock "cinder-133f3844-7bc4-4bce-88c9-de5fb01dd86c-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Lock "cinder-133f3844-7bc4-4bce-88c9-de5fb01dd86c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] remove_export for volume: 133f3844-7bc4-4bce-88c9-de5fb01dd86c. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-65836439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=133f3844-7bc4-4bce-88c9-de5fb01dd86c,launched_at=2023-04-14T01:40:46Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='796f89d4b8524e30b60b1a23b5873486',provider_auth='CHAP AmRlZWjM HzIMFqAbYGBwJT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:45Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:40:53Z,updated_at=2023-04-14T01:40:53Z,use_quota=True,user_id='cb374a2b129a43d498365a50bd0bf59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] detach volume v_133f3844-7bc4-4bce-88c9-de5fb01dd86c from target iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c/luns/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c/luns/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c/luns/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c/luns/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] failed to remove resource iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c because of JDSS resource v_133f3844-7bc4-4bce-88c9-de5fb01dd86c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] delete target: iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] delete target iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] failed to remove resource iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c because of JDSS resource iqn.2010-10.org.openstack:133f3844-7bc4-4bce-88c9-de5fb01dd86c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] deleating volume v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] get snapshots for volume v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] get volume v_133f3844-7bc4-4bce-88c9-de5fb01dd86c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437854', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110184', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11776516266686726303', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7b0781259ff22692', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331570176', 'san:volume_id': '7b0781259ff2269246bccac73f370b762eaa63be', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81817', 'name': 'v_133f3844-7bc4-4bce-88c9-de5fb01dd86c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] delete volume:v_133f3844-7bc4-4bce-88c9-de5fb01dd86c recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331570176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.manager [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_060154b9-311a-4781-85d4-3b7aea6601b6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] volume v_060154b9-311a-4781-85d4-3b7aea6601b6 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:40:53 user cinder-volume[73579]: INFO cinder.volume.manager [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Deleted volume successfully. Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-85ddb3b5-6443-41ac-adff-b42f0e08ca61 tempest-VolumesTestJSON-581132467 None] Lock "cinder-61190ed3-dd15-4a87-84fb-99edfb2d8008-delete_volume" released by "delete_volume" :: held 4.040s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.quota [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Created reservations ['720917ef-850f-41aa-aa5a-46b71d6b1bc4', 'ba909dd6-d35e-40cb-add1-339f641f79bf', '540720f2-9408-46f6-b1d8-e815730c644d', 'b7abadeb-ff4f-4228-bbac-83fd4c0ebe12'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331570176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:54 user cinder-volume[73579]: DEBUG cinder.manager [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:54 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Deleted volume successfully. Apr 14 01:40:54 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0851eb54-9633-4453-a510-e755d1eea202 tempest-VolumeQuotasNegativeTestJSON-1011285191 None] Lock "cinder-060154b9-311a-4781-85d4-3b7aea6601b6-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (31352ac8-b31e-471a-a44a-58b9d054c685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b750e69-1b3b-4d3a-bb02-fc836695dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b750e69-1b3b-4d3a-bb02-fc836695dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1585672458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=63f6bc8e-c369-4078-a8b0-fa164e56a994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:55Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da17589-ba23-4e09-aa37-d30c26413551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da17589-ba23-4e09-aa37-d30c26413551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2583ab42-88a6-4e1a-9247-f4821d2e9ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2583ab42-88a6-4e1a-9247-f4821d2e9ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63f6bc8e-c369-4078-a8b0-fa164e56a994', 'volume_name': 'volume-63f6bc8e-c369-4078-a8b0-fa164e56a994', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae918a1-dcd2-4760-9f06-9a68bfab1cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae918a1-dcd2-4760-9f06-9a68bfab1cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e905e73-a5f5-4d36-aa58-cb497481a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:40:55 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Volume 63f6bc8e-c369-4078-a8b0-fa164e56a994: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63f6bc8e-c369-4078-a8b0-fa164e56a994', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Cloning 63f6bc8e-c369-4078-a8b0-fa164e56a994 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.coordination [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.coordination [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Preparing cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 01:40:55 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2, size 15.55 MB, duration 1.00 sec {{(pid=73579) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 01:40:56 user cinder-volume[73579]: INFO cinder.image.image_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Image download 15.55 MB at 15.55 MB/s Apr 14 01:40:56 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:40:56 user sudo[80333]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 Apr 14 01:40:56 user sudo[80333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_133f3844-7bc4-4bce-88c9-de5fb01dd86c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] volume v_133f3844-7bc4-4bce-88c9-de5fb01dd86c deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.quota [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Created reservations ['3157fbbf-f229-47fb-a870-95a4208cee0f', '54532d9c-38c8-407f-81a5-c45c8daa5e3a', '565baa5e-b9fb-42c7-b4cb-ad78be87489e', '453f35c5-c8d9-4a51-8467-22314a902f3a'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=59,cinder:DELETE=3,cinder:UPDATE=31,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:56 user sudo[80333]: pam_unix(sudo:session): session closed for user root Apr 14 01:40:56 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2" returned: 0 in 0.776s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:40:56 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Temporary image b1bc26f9-63fb-4bff-8f72-f1e49544441d is fetched for user b3255f4b4cbe40a589cfc5a1dff7dd77. {{(pid=73579) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:40:57 user sudo[80362]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 Apr 14 01:40:57 user sudo[80362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331652096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.manager [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:40:57 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Deleted volume successfully. Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c3e000cc-3ac1-439d-8e58-7ba1ca9c325d tempest-VolumesTestJSON-581132467 None] Lock "cinder-133f3844-7bc4-4bce-88c9-de5fb01dd86c-delete_volume" released by "delete_volume" :: held 4.347s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Acquiring lock "cinder-6448ba63-3837-41ef-bb75-176c1562f669-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Lock "cinder-6448ba63-3837-41ef-bb75-176c1562f669-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] remove_export for volume: 6448ba63-3837-41ef-bb75-176c1562f669. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555509389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6448ba63-3837-41ef-bb75-176c1562f669,launched_at=2023-04-14T01:40:44Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='796f89d4b8524e30b60b1a23b5873486',provider_auth='CHAP rdhEjIKo 9p5Qbc8zfVNtam',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:40:57Z,updated_at=2023-04-14T01:40:57Z,use_quota=True,user_id='cb374a2b129a43d498365a50bd0bf59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] detach volume v_6448ba63-3837-41ef-bb75-176c1562f669 from target iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669/luns/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669/luns/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669/luns/v_6448ba63-3837-41ef-bb75-176c1562f669'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669/luns/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] failed to remove resource iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 because of JDSS resource v_6448ba63-3837-41ef-bb75-176c1562f669 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] delete target: iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] delete target iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] failed to remove resource iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 because of JDSS resource iqn.2010-10.org.openstack:6448ba63-3837-41ef-bb75-176c1562f669 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] deleating volume v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] get snapshots for volume v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:57 user sudo[80362]: pam_unix(sudo:session): session closed for user root Apr 14 01:40:57 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2" returned: 0 in 0.801s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] creating volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] create volume {'name': 'v_63f6bc8e-c369-4078-a8b0-fa164e56a994', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] get volume v_6448ba63-3837-41ef-bb75-176c1562f669 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6448ba63-3837-41ef-bb75-176c1562f669', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437852', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110178', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5895826466562335762', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1f0cc8b301b1d6e5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331652096', 'san:volume_id': '1f0cc8b301b1d6e56cb1863547a747523fcf50b7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81806', 'name': 'v_6448ba63-3837-41ef-bb75-176c1562f669', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] delete volume:v_6448ba63-3837-41ef-bb75-176c1562f669 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_63f6bc8e-c369-4078-a8b0-fa164e56a994', 'is_clone': False, 'name': 'v_63f6bc8e-c369-4078-a8b0-fa164e56a994'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Attempting download of b1bc26f9-63fb-4bff-8f72-f1e49544441d ((None, None)) to volume 63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] copy_image_to_volume volume-63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 01:40:58 user cinder-volume[73579]: DEBUG os_brick.utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 01:40:58 user cinder-volume[73579]: INFO oslo.privsep.daemon [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprsa38r8i/privsep.sock'] Apr 14 01:40:58 user sudo[80388]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprsa38r8i/privsep.sock Apr 14 01:40:58 user sudo[80388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6448ba63-3837-41ef-bb75-176c1562f669 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] volume v_6448ba63-3837-41ef-bb75-176c1562f669 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.quota [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Created reservations ['9150ac55-33e9-4fa7-8e97-504d15b4382d', '3a57f4b5-3d8d-4dae-9c94-589f6dff1f5e', '5df11e65-7130-48be-b50c-cf31e369b5e6', 'ebda39c2-02c9-4266-a8b7-0cda166c7543'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:00 user sudo[80388]: pam_unix(sudo:session): session closed for user root Apr 14 01:41:00 user cinder-volume[73579]: INFO oslo.privsep.daemon [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Spawned new privsep daemon via rootwrap Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Accepted privsep connection to /tmp/tmprsa38r8i/privsep.sock {{(pid=73579) __init__ /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:362}} Apr 14 01:41:00 user cinder-volume[73579]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 14 01:41:00 user cinder-volume[73579]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 14 01:41:00 user cinder-volume[73579]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none Apr 14 01:41:00 user cinder-volume[73579]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80440 Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eaf51d-454e-41b6-a6a2-c762fb1d285a]: (2,) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5af90-b430-498f-b929-f75cfabf5890]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:00 user cinder-volume[73579]: WARNING os_brick.initiator.connectors.nvmeof [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba852e4-232b-4a3b-b8d9-a72d46bb7018]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d1f66f-c21f-4840-9cc7-add0ba5bbb21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12b840b-a134-4e6f-969e-a03274d96364]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): nvme version {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] 'nvme version' failed. Not Retrying. {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.nvmeof [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] nvme not present on system {{(pid=73579) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Flow 'volume_create_manager' (56bf6a51-b2f8-448d-a74c-2a14c1f426ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63aa0128-3457-4a5c-9997-1b9eb6a2ecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 01:41:00 user cinder-volume[73579]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 01:41:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4749e63-ae38-43c9-9dd6-894a75fcb487]: (4, '') {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73579) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73579) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] LIGHTOS: no hostnqn found. {{(pid=73579) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG os_brick.utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] <== get_connector_properties: return (2249ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Volume 63f6bc8e-c369-4078-a8b0-fa164e56a994: creating export {{(pid=73579) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] create export for volume: 63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] ensure volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] check if targe iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63aa0128-3457-4a5c-9997-1b9eb6a2ecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1868813248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7113332c-fb29-4657-be57-be86d245b411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e707623638044e983b557119edd7673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:01Z,use_quota=True,user_id='f6e19e75aa9d4cda971c8d2449e85290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57348d7d-1c5a-4a35-b3b1-7c2b578df561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57348d7d-1c5a-4a35-b3b1-7c2b578df561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ce27ba-4a71-4b05-8685-175fd468392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ce27ba-4a71-4b05-8685-175fd468392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7113332c-fb29-4657-be57-be86d245b411', 'volume_name': 'volume-7113332c-fb29-4657-be57-be86d245b411', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8270ef-c8ab-4aec-8feb-71d454a75e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8270ef-c8ab-4aec-8feb-71d454a75e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c43c73d-6f7d-4b12-91ea-ff2c696e50d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:01 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Volume 7113332c-fb29-4657-be57-be86d245b411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7113332c-fb29-4657-be57-be86d245b411', 'volume_size': 1} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] creating volume v_7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] create volume {'name': 'v_7113332c-fb29-4657-be57-be86d245b411', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] create target and attach volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] create target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331639808', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.manager [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:01 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Deleted volume successfully. Apr 14 01:41:01 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=53,cinder:INSERT=9,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:01 user cinder-volume[73579]: DEBUG cinder.coordination [None req-8b0bef51-589f-498d-b288-8e743608ca13 tempest-VolumesTestJSON-581132467 None] Lock "cinder-6448ba63-3837-41ef-bb75-176c1562f669-delete_volume" released by "delete_volume" :: held 3.700s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Flow 'volume_create_manager' (215c2d34-15f0-4989-95e9-50a603142bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbf6576-f24e-4a33-ab34-8679bae4a0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbf6576-f24e-4a33-ab34-8679bae4a0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2085378583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e9b1e2c-15a4-481a-a713-fa24dca0918e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:02Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c593d50-da42-4377-a3f9-6c110352066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c593d50-da42-4377-a3f9-6c110352066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa887e-541d-4eae-ab80-1cf0b70e9f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa887e-541d-4eae-ab80-1cf0b70e9f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'volume_name': 'volume-5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6f27fe-ba73-40c2-a2d0-bde476b27562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6f27fe-ba73-40c2-a2d0-bde476b27562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c5f14a-0431-4986-98e7-7194f6e281fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Volume 5e9b1e2c-15a4-481a-a713-fa24dca0918e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Cloning 5e9b1e2c-15a4-481a-a713-fa24dca0918e from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:41:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Flow 'volume_create_manager' (30a51602-781f-4e11-845a-683db7ce9108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec7429-9660-468c-bff8-631e733eb3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec7429-9660-468c-bff8-631e733eb3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1011104471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=217c01bb-a21b-4ff9-9e57-99dba019914b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f0122cc9864fcea660891e2826ca7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:03Z,use_quota=True,user_id='2bada5cdb7704f6b956eb48b3729388d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010628a7-dfc4-46bd-b206-495064b6d6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010628a7-dfc4-46bd-b206-495064b6d6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e2adb4-eafa-44d6-a094-a1d94804ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e2adb4-eafa-44d6-a094-a1d94804ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217c01bb-a21b-4ff9-9e57-99dba019914b', 'volume_name': 'volume-217c01bb-a21b-4ff9-9e57-99dba019914b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7301b6-2292-4fff-92eb-87879adb87e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7301b6-2292-4fff-92eb-87879adb87e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc3b212-0ac9-449d-851c-931e9b830068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Volume 217c01bb-a21b-4ff9-9e57-99dba019914b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217c01bb-a21b-4ff9-9e57-99dba019914b', 'volume_size': 1} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] creating volume v_217c01bb-a21b-4ff9-9e57-99dba019914b. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] create volume {'name': 'v_217c01bb-a21b-4ff9-9e57-99dba019914b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Flow 'volume_create_manager' (1ebf5739-9dd6-4db4-8666-9f61ec04faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d3c7b0-fd5f-4904-be8d-fd60125ff1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d3c7b0-fd5f-4904-be8d-fd60125ff1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1678650615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=18da1956-0e76-484f-a9f7-83edc5dc0f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b7cf6a5c534755836e8c94cbd5ada8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:04Z,use_quota=True,user_id='87030eefb329456681262731e81c425e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8467424-011e-4856-bcb8-1135a1a62c03),volume_type_id=c8467424-011e-4856-bcb8-1135a1a62c03)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2c376e-4b15-4259-9846-b0a2d0424f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2c376e-4b15-4259-9846-b0a2d0424f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8620a3b6-492f-4b95-91c2-0f3ed2a305ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8620a3b6-492f-4b95-91c2-0f3ed2a305ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18da1956-0e76-484f-a9f7-83edc5dc0f26', 'volume_name': 'volume-18da1956-0e76-484f-a9f7-83edc5dc0f26', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a586ed-2b56-4a41-af91-459bac22ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a586ed-2b56-4a41-af91-459bac22ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f49610-5ebc-45a7-9a5b-733ff2f27612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Volume 18da1956-0e76-484f-a9f7-83edc5dc0f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18da1956-0e76-484f-a9f7-83edc5dc0f26', 'volume_size': 1} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] creating volume v_18da1956-0e76-484f-a9f7-83edc5dc0f26. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] create volume {'name': 'v_18da1956-0e76-484f-a9f7-83edc5dc0f26', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_217c01bb-a21b-4ff9-9e57-99dba019914b', 'is_clone': False, 'name': 'v_217c01bb-a21b-4ff9-9e57-99dba019914b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc3b212-0ac9-449d-851c-931e9b830068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217c01bb-a21b-4ff9-9e57-99dba019914b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a996cc-f295-41f6-a3f0-060c520a822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:04 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Volume volume-217c01bb-a21b-4ff9-9e57-99dba019914b (217c01bb-a21b-4ff9-9e57-99dba019914b): created successfully Apr 14 01:41:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a996cc-f295-41f6-a3f0-060c520a822e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Flow 'volume_create_manager' (30a51602-781f-4e11-845a-683db7ce9108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5d2e7b4b-130c-4f22-8d5b-14a365b72911 tempest-TaggedAttachmentsTest-242857735 None] Created volume successfully. Apr 14 01:41:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] atach volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994 to target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:41:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_18da1956-0e76-484f-a9f7-83edc5dc0f26', 'is_clone': False, 'name': 'v_18da1956-0e76-484f-a9f7-83edc5dc0f26'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f49610-5ebc-45a7-9a5b-733ff2f27612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18da1956-0e76-484f-a9f7-83edc5dc0f26', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ba0c5a-976d-43e8-843a-a9bc6121f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:06 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Volume volume-18da1956-0e76-484f-a9f7-83edc5dc0f26 (18da1956-0e76-484f-a9f7-83edc5dc0f26): created successfully Apr 14 01:41:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ba0c5a-976d-43e8-843a-a9bc6121f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Flow 'volume_create_manager' (1ebf5739-9dd6-4db4-8666-9f61ec04faaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-237b6353-b735-4d2d-b380-e2bc5489a017 tempest-VolumeTypesTest-38331855 None] Created volume successfully. Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7113332c-fb29-4657-be57-be86d245b411', 'is_clone': False, 'name': 'v_7113332c-fb29-4657-be57-be86d245b411'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c43c73d-6f7d-4b12-91ea-ff2c696e50d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7113332c-fb29-4657-be57-be86d245b411', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b1831a-d540-4c10-8a11-ad7cd5b8a6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:07 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Volume volume-7113332c-fb29-4657-be57-be86d245b411 (7113332c-fb29-4657-be57-be86d245b411): created successfully Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b1831a-d540-4c10-8a11-ad7cd5b8a6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Flow 'volume_create_manager' (56bf6a51-b2f8-448d-a74c-2a14c1f426ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7552bc5f-dc2e-413b-bcf4-86cc220bf0fa tempest-TestVolumeSwap-755712300 None] Created volume successfully. Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Flow 'volume_create_manager' (396f1092-af93-4a86-a8ae-b921479eba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c667a0-566e-4d25-8cba-1e20bebc21ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c667a0-566e-4d25-8cba-1e20bebc21ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1182241430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ddd73274-308f-4d71-9930-9ed144269534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e707623638044e983b557119edd7673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:08Z,use_quota=True,user_id='f6e19e75aa9d4cda971c8d2449e85290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494aebe2-f66e-4ec0-9e9e-0ca299ffcf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494aebe2-f66e-4ec0-9e9e-0ca299ffcf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77992f61-3deb-4511-a0ed-356550f88f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77992f61-3deb-4511-a0ed-356550f88f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd73274-308f-4d71-9930-9ed144269534', 'volume_name': 'volume-ddd73274-308f-4d71-9930-9ed144269534', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f29c592-5c8f-4eee-9061-e92158f4be00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f29c592-5c8f-4eee-9061-e92158f4be00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acef7274-0814-4178-aa4f-0928f0442193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:08 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Volume ddd73274-308f-4d71-9930-9ed144269534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd73274-308f-4d71-9930-9ed144269534', 'volume_size': 1} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] creating volume v_ddd73274-308f-4d71-9930-9ed144269534. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] create volume {'name': 'v_ddd73274-308f-4d71-9930-9ed144269534', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.coordination [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Acquiring lock "cinder-18da1956-0e76-484f-a9f7-83edc5dc0f26-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.coordination [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Lock "cinder-18da1956-0e76-484f-a9f7-83edc5dc0f26-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] remove_export for volume: 18da1956-0e76-484f-a9f7-83edc5dc0f26. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1678650615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=18da1956-0e76-484f-a9f7-83edc5dc0f26,launched_at=2023-04-14T01:41:06Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='64b7cf6a5c534755836e8c94cbd5ada8',provider_auth='CHAP zjwCPUZr xOz8BuU7lDFnN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:09Z,updated_at=2023-04-14T01:41:09Z,use_quota=True,user_id='87030eefb329456681262731e81c425e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bb28110-0ddf-4f01-b0a6-fc2209a10880),volume_type_id=1bb28110-0ddf-4f01-b0a6-fc2209a10880) from target:iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] detach volume v_18da1956-0e76-484f-a9f7-83edc5dc0f26 from target iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26/luns/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26/luns/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26/luns/v_18da1956-0e76-484f-a9f7-83edc5dc0f26'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26/luns/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] failed to remove resource iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 because of JDSS resource v_18da1956-0e76-484f-a9f7-83edc5dc0f26 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] delete target: iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] delete target iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] failed to remove resource iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 because of JDSS resource iqn.2010-10.org.openstack:18da1956-0e76-484f-a9f7-83edc5dc0f26 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] deleating volume v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] get snapshots for volume v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3231623838393734', 'lun': 0, 'mode': 'wt', 'name': 'v_63f6bc8e-c369-4078-a8b0-fa164e56a994', 'prod_id': 'Storage', 'scsi_id': '21b88974b0e44e6a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] add credentails to target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] get volume v_18da1956-0e76-484f-a9f7-83edc5dc0f26 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_18da1956-0e76-484f-a9f7-83edc5dc0f26', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437874', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110212', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4079950691743476806', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '720176957200ccd4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331418624', 'san:volume_id': '720176957200ccd4bdc5f64396bfd9c6fb7e416f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81930', 'name': 'v_18da1956-0e76-484f-a9f7-83edc5dc0f26', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] delete volume:v_18da1956-0e76-484f-a9f7-83edc5dc0f26 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331418624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:10 user cinder-volume[73579]: DEBUG cinder.manager [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:10 user cinder-volume[73579]: INFO cinder.volume.manager [None req-453a27a6-ac46-45a7-9562-60d57591ab24 tempest-VolumeTypesTest-38331855 None] Retype volume completed successfully. Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ddd73274-308f-4d71-9930-9ed144269534', 'is_clone': False, 'name': 'v_ddd73274-308f-4d71-9930-9ed144269534'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acef7274-0814-4178-aa4f-0928f0442193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd73274-308f-4d71-9930-9ed144269534', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3460af1-800c-4e6c-b9f2-789029afaf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:11 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Volume volume-ddd73274-308f-4d71-9930-9ed144269534 (ddd73274-308f-4d71-9930-9ed144269534): created successfully Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3460af1-800c-4e6c-b9f2-789029afaf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Flow 'volume_create_manager' (396f1092-af93-4a86-a8ae-b921479eba8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'eygELFHt'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:11 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6467bbee-3f91-41ec-839f-532e82b4c9d8 tempest-TestVolumeSwap-755712300 None] Created volume successfully. Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] initialize_connection for 63f6bc8e-c369-4078-a8b0-fa164e56a994 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connector [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Factory for iscsi on None {{(pid=73579) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eygELFHt', 'auth_password': '***', 'target_lun': False}}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 01:41:11 user cinder-volume[73579]: INFO os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53265f9-e4bb-4114-a762-f80d2b97b911]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 01:41:11 user cinder-volume[73579]: {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --interface default --op new {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd38de4f-a53c-4cb8-b52e-6495227eaa81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994] added\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994] added Apr 14 01:41:11 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[95953c03-9452-48d1-a9de-c1ecc190cc18]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29251db-d562-4803-84dc-b5bd3f0bee3b]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eygELFHt {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eygELFHt" returned: 0 in 0.036s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[92309fdc-9a64-40c3-ad23-43d4e0afb9fa]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eygELFHt'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226e971-8b6d-4a9a-99e1-2381fdeb45b5]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[950ada09-c2a7-4958-9af9-f038f3bf8795]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Apr 14 01:41:11 user cinder-volume[73579]: {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Apr 14 01:41:11 user cinder-volume[73579]: {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 01:41:11 user cinder-volume[73579]: WARNING os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Apr 14 01:41:11 user cinder-volume[73579]: Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --login {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a9f8db-76cb-4e74-8b7b-cc1a3f9f1e63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260] Apr 14 01:41:11 user cinder-volume[73579]: Login to [iface: default, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260] successful. Apr 14 01:41:11 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1afa73-efb7-48a8-9b7f-6475014743de]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_18da1956-0e76-484f-a9f7-83edc5dc0f26 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] volume v_18da1956-0e76-484f-a9f7-83edc5dc0f26 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[650fdece-dcce-4f02-a0d3-c5826129e84f]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 (non-flash) Apr 14 01:41:11 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 (non-flash) Apr 14 01:41:11 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Connected to 172.16.0.220:3260 {{(pid=73579) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=73579) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Scanning host 33 c: -, t: -, l: 0) {{(pid=73579) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:11 user cinder-volume[73579]: WARNING cinder.quota [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-79508172 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-79508172, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:41:11 user cinder-volume[73579]: WARNING cinder.quota [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-79508172 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-79508172, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a72db79-f792-4524-a5be-99e251851ce7]: (4, ('- - 0', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73579) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eygELFHt', 'auth_password': '***', 'target_lun': False} {{(pid=73579) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.quota [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Created reservations ['57f01634-4d71-4521-a68f-6d96ee7030ff', '62261864-0576-4677-a44b-bb78fda8f810', '2c0cb5ba-39d5-4f85-84d0-fc788a94fe60', '4774e64e-4876-4b14-ba4f-974c98b83205'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=33,cinder:SELECT=61,cinder:INSERT=3,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331418624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG cinder.manager [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '23231623838393734', 'path': '/dev/sdb'} {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 01:41:12 user cinder-volume[73579]: INFO cinder.volume.manager [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Deleted volume successfully. Apr 14 01:41:12 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdb of=/dev/null count=1 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-dacc13c9-c70e-4559-a3a8-6daef6becd8b tempest-VolumeTypesTest-38331855 None] Lock "cinder-18da1956-0e76-484f-a9f7-83edc5dc0f26-delete_volume" released by "delete_volume" :: held 4.223s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdb of=/dev/null count=1" returned: 0 in 0.070s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[14071324-4e12-49bc-a98e-bb764427f4c1]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00249611 s, 205 kB/s\n')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:12 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_b1bc26f9-63fb-4bff-8f72-f1e49544441d_3u30urvg {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:13 user sudo[80901]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_b1bc26f9-63fb-4bff-8f72-f1e49544441d_3u30urvg Apr 14 01:41:13 user sudo[80901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:41:14 user sudo[80901]: pam_unix(sudo:session): session closed for user root Apr 14 01:41:14 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_b1bc26f9-63fb-4bff-8f72-f1e49544441d_3u30urvg" returned: 0 in 1.162s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:14 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:14 user sudo[80948]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 Apr 14 01:41:14 user sudo[80948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:41:15 user sudo[80948]: pam_unix(sudo:session): session closed for user root Apr 14 01:41:15 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2" returned: 0 in 1.173s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:15 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] b1bc26f9-63fb-4bff-8f72-f1e49544441d was qcow2, converting to raw {{(pid=73579) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 01:41:15 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 of=/dev/sdb oflag=direct {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:15 user sudo[80959]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 of=/dev/sdb oflag=direct Apr 14 01:41:15 user sudo[80959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:41:16 user sudo[80959]: pam_unix(sudo:session): session closed for user root Apr 14 01:41:16 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 of=/dev/sdb oflag=direct" returned: 0 in 0.940s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:16 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 /dev/sdb {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:16 user sudo[80973]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 /dev/sdb Apr 14 01:41:16 user sudo[80973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:41:18 user sudo[80973]: pam_unix(sudo:session): session closed for user root Apr 14 01:41:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 /dev/sdb" returned: 0 in 2.496s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:18 user sudo[81143]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2 Apr 14 01:41:18 user sudo[81143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:41:19 user sudo[81143]: pam_unix(sudo:session): session closed for user root Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2" returned: 0 in 0.923s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1bc26f9-63fb-4bff-8f72-f1e49544441d_kwl2q5giuser@joviandss-2, size 112.00 MB, duration 2.50 sec, destination /dev/sdb {{(pid=73579) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 01:41:19 user cinder-volume[73579]: INFO cinder.image.image_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Converted 112.00 MB image at 44.83 MB/s Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eygELFHt', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23231623838393734', 'path': '/dev/sdb'}), 'kwargs': {'force': False}}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b45aa21-8ae2-4dd9-bca7-ff997cc93315]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 01:41:19 user cinder-volume[73579]: No targets found. Apr 14 01:41:19 user cinder-volume[73579]: iSNS: Apr 14 01:41:19 user cinder-volume[73579]: No targets found. Apr 14 01:41:19 user cinder-volume[73579]: STATIC: Apr 14 01:41:19 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 Apr 14 01:41:19 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:41:19 user cinder-volume[73579]: Iface Name: default Apr 14 01:41:19 user cinder-volume[73579]: FIRMWARE: Apr 14 01:41:19 user cinder-volume[73579]: No targets found. Apr 14 01:41:19 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 01:41:19 user cinder-volume[73579]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 01:41:19 user cinder-volume[73579]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73579) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994', 0)] {{(pid=73579) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca3f9d3-6266-4f72-a9cb-55335db0a774]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc8db74-8cff-43ac-974e-6e9866b55532]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 (non-flash) Apr 14 01:41:19 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 (non-flash) Apr 14 01:41:19 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Resulting device map defaultdict(. at 0x7f9f6ef09360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994'): ({'sdb'}, set())}) {{(pid=73579) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Removing single pathed devices sdb {{(pid=73579) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.043s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[441d5b34-0b47-4d93-b8e1-7ffa4281530e]: (4, ('path checker states:\nup 1\n\npaths: 0\nbusy: False\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd1cbaf-aea2-43cb-a2a4-ef125cc09a17]: (4, ('ok\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Flushing IO for device /dev/sdb {{(pid=73579) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 01:41:19 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.061s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eaedd4-7350-47cd-9946-162172d2e210]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73579) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.079s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[33beb746-5324-4060-acff-bd79b0ed64d3]: (4, ('1', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=73579) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] SCSI volumes sdb have been removed. {{(pid=73579) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994')] {{(pid=73579) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2240d6-a2cd-4ece-a2e6-e67ab15b55da]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --logout {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[be979ae9-53e4-41a6-9f83-79a7c64497d2]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260] Apr 14 01:41:20 user cinder-volume[73579]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994, portal: 172.16.0.220,3260] successful. Apr 14 01:41:20 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op delete {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a2c11b-90ac-4f28-9ef6-4f0dbbff5320]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.516s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] <== disconnect_volume: return (518ms) None {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] terminate connection for 63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] volume 63f6bc8e-c369-4078-a8b0-fa164e56a994: removing export {{(pid=73579) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] remove_export for volume: 63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1585672458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=63f6bc8e-c369-4078-a8b0-fa164e56a994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth='CHAP eygELFHt JfdMsL64gVxoTr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T01:40:55Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] detach volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994 from target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Flow 'volume_create_manager' (425d3329-5359-46d6-82e1-d57ba1fc6ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd62eb4-a049-41af-afa2-3762a9fcd6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd62eb4-a049-41af-afa2-3762a9fcd6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1697010101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=85e3b47d-db41-4513-a049-843717ef8f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ab28c9ab6a4261bd23d8e38b430304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:20Z,use_quota=True,user_id='b0c54e2fdd324e109d8eed547b39dc43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2568904e-f371-47dd-9d6c-faadf711192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2568904e-f371-47dd-9d6c-faadf711192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6bbd1a-a46c-40cd-960d-238d78141f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6bbd1a-a46c-40cd-960d-238d78141f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85e3b47d-db41-4513-a049-843717ef8f86', 'volume_name': 'volume-85e3b47d-db41-4513-a049-843717ef8f86', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d171c02c-64d4-444e-8924-3dc48bb33201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d171c02c-64d4-444e-8924-3dc48bb33201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e022a0fa-7152-4667-92bf-326180076ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:20 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Volume 85e3b47d-db41-4513-a049-843717ef8f86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85e3b47d-db41-4513-a049-843717ef8f86', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Cloning 85e3b47d-db41-4513-a049-843717ef8f86 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] delete target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] delete target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Flow 'volume_create_manager' (aad8b826-7d5a-404f-8603-5dba21b227db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273740a2-63b9-4038-a3db-eef85e8b4fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Downloaded image b1bc26f9-63fb-4bff-8f72-f1e49544441d ((None, None)) to volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 successfully. {{(pid=73579) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Temporary image b1bc26f9-63fb-4bff-8f72-f1e49544441d for user b3255f4b4cbe40a589cfc5a1dff7dd77 is deleted. {{(pid=73579) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273740a2-63b9-4038-a3db-eef85e8b4fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2037849236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=176af74d-4379-4754-b486-41f3d3aeacc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735f307ed61e412c9f19df63012f0b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:21Z,use_quota=True,user_id='b8366ee00ca849878fb59e62747c9f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bd140b-5674-4e06-9e6c-d22194f568d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bd140b-5674-4e06-9e6c-d22194f568d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50610f76-0522-4b08-b03b-60e5adeb9221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50610f76-0522-4b08-b03b-60e5adeb9221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176af74d-4379-4754-b486-41f3d3aeacc1', 'volume_name': 'volume-176af74d-4379-4754-b486-41f3d3aeacc1', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3097ff50-b4f9-43f8-8aab-f69c0eb06564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3097ff50-b4f9-43f8-8aab-f69c0eb06564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9621603a-3978-4089-991b-0941ab7f6bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Volume 176af74d-4379-4754-b486-41f3d3aeacc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176af74d-4379-4754-b486-41f3d3aeacc1', 'volume_size': 1} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] creating volume v_176af74d-4379-4754-b486-41f3d3aeacc1. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] create volume {'name': 'v_176af74d-4379-4754-b486-41f3d3aeacc1', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.quota [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Created reservations ['7fa1ca03-8e96-4090-9456-0a73fe1b5584', '959f2c1a-e25f-41c2-9867-9b8a8f3bf3fc', 'c9b70aab-d6dd-4f3e-9393-457b31aed929', 'db775212-3438-4db5-bd5f-a8747791ae51'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Creating image volume entry: {'provider_id': None, 'volume_metadata': [], 'encryption_key_id': None, 'replication_driver_data': None, 'updated_at': datetime.datetime(2023, 4, 14, 1, 40, 55, tzinfo=datetime.timezone.utc), 'deleted': False, 'provider_geometry': None, 'consistencygroup_id': None, 'volume_admin_metadata': [], 'metadata': {}, 'replication_extended_status': None, 'group_id': None, 'display_description': None, 'deleted_at': None, 'project_id': '09d20380b49e4ac2a78e44d2973ed7ce', 'display_name': 'image-b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'terminated_at': None, 'shared_targets': True, 'cluster_name': None, 'scheduled_at': datetime.datetime(2023, 4, 14, 1, 40, 55, tzinfo=datetime.timezone.utc), 'availability_zone': 'nova', 'bootable': False, 'created_at': datetime.datetime(2023, 4, 14, 1, 40, 55, tzinfo=datetime.timezone.utc), 'multiattach': False, 'service_uuid': None, 'volume_type_id': 'a7f0dbc7-361a-485c-8eb6-9d153274392e', 'launched_at': None, 'ec2_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 0', 'size': 1, 'user_id': 'b3255f4b4cbe40a589cfc5a1dff7dd77', 'replication_status': None, 'host': 'user@joviandss-2#joviandss-2', 'previous_status': None, 'provider_auth': 'CHAP eygELFHt JfdMsL64gVxoTr', 'attach_status': 'detached', 'status': 'creating', 'source_volid': '63f6bc8e-c369-4078-a8b0-fa164e56a994'}. {{(pid=73579) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Volume reschedule parameters: False retry: None {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (c56c8cdf-9a6b-4299-a1d1-ffb49856ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2371791-06c1-44f9-af17-b83db5dfac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2371791-06c1-44f9-af17-b83db5dfac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='image-b1bc26f9-63fb-4bff-8f72-f1e49544441d',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ccaaa5cb-e964-406f-baca-e7660e8ceff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d20380b49e4ac2a78e44d2973ed7ce',provider_auth='CHAP eygELFHt JfdMsL64gVxoTr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=63f6bc8e-c369-4078-a8b0-fa164e56a994,status='creating',terminated_at=None,updated_at=2023-04-14T01:40:55Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d4b55-e8b6-4f25-918f-b86d530e2ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d4b55-e8b6-4f25-918f-b86d530e2ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ef2e4f-ade7-4947-bc67-4758156cb855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ef2e4f-ade7-4947-bc67-4758156cb855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'volume_name': 'volume-ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'volume_size': 1, 'source_volid': '63f6bc8e-c369-4078-a8b0-fa164e56a994', 'source_volstatus': 'downloading'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1847300-15f1-4520-b9d1-d0be81c4b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1847300-15f1-4520-b9d1-d0be81c4b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192cf1da-d693-48b2-b1a6-ec0ea1187958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:21 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Volume ccaaa5cb-e964-406f-baca-e7660e8ceff4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'volume_size': 1, 'source_volid': '63f6bc8e-c369-4078-a8b0-fa164e56a994', 'source_volstatus': 'downloading'} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] cloned volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 to ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] cloning v_63f6bc8e-c369-4078-a8b0-fa164e56a994 to v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] create snapshot v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_176af74d-4379-4754-b486-41f3d3aeacc1', 'is_clone': False, 'name': 'v_176af74d-4379-4754-b486-41f3d3aeacc1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9621603a-3978-4089-991b-0941ab7f6bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176af74d-4379-4754-b486-41f3d3aeacc1', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a67b64-afa9-41ee-b385-e9cb242e3d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:22 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Volume volume-176af74d-4379-4754-b486-41f3d3aeacc1 (176af74d-4379-4754-b486-41f3d3aeacc1): created successfully Apr 14 01:41:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a67b64-afa9-41ee-b385-e9cb242e3d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Flow 'volume_create_manager' (aad8b826-7d5a-404f-8603-5dba21b227db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cde2155a-49b4-45db-9dde-dac1829f66fb tempest-VolumesListAdminTestJSON-158510996 None] Created volume successfully. Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_ccaaa5cb-e964-406f-baca-e7660e8ceff4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] create volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 from snapshot v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Flow 'volume_create_manager' (8753aeec-273c-4a8a-9875-b081262d5a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee944850-f666-4de4-8afc-70bce17e3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee944850-f666-4de4-8afc-70bce17e3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952514930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2788e15b-59a0-4671-b9f5-37f887524ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735f307ed61e412c9f19df63012f0b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:24Z,use_quota=True,user_id='b8366ee00ca849878fb59e62747c9f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44e6d9d-3639-40a0-9552-61e12d324e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44e6d9d-3639-40a0-9552-61e12d324e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a156be-33db-4a2a-ac31-c0857cd5337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a156be-33db-4a2a-ac31-c0857cd5337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2788e15b-59a0-4671-b9f5-37f887524ec5', 'volume_name': 'volume-2788e15b-59a0-4671-b9f5-37f887524ec5', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515836a7-4bb7-4103-be47-217752466a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515836a7-4bb7-4103-be47-217752466a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88367075-e8ac-46f5-85e4-b8ccdcbfe933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Volume 2788e15b-59a0-4671-b9f5-37f887524ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2788e15b-59a0-4671-b9f5-37f887524ec5', 'volume_size': 1} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] creating volume v_2788e15b-59a0-4671-b9f5-37f887524ec5. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] create volume {'name': 'v_2788e15b-59a0-4671-b9f5-37f887524ec5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_63f6bc8e-c369-4078-a8b0-fa164e56a994@v_ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'is_clone': True, 'full_name': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'name': 'v_ccaaa5cb-e964-406f-baca-e7660e8ceff4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] get volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_63f6bc8e-c369-4078-a8b0-fa164e56a994@v_ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437892', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110241', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10009241192557315096', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b1139e97a82ed24d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114315075584', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '81865', 'name': 'v_ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192cf1da-d693-48b2-b1a6-ec0ea1187958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'volume_size': 1, 'source_volid': '63f6bc8e-c369-4078-a8b0-fa164e56a994', 'source_volstatus': 'downloading'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05846373-df29-4bef-bb2b-4b9e2846a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Volume volume-ccaaa5cb-e964-406f-baca-e7660e8ceff4 (ccaaa5cb-e964-406f-baca-e7660e8ceff4): created successfully Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05846373-df29-4bef-bb2b-4b9e2846a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (c56c8cdf-9a6b-4299-a1d1-ffb49856ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Created volume successfully. Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Creating new image-volume cache entry for image b1bc26f9-63fb-4bff-8f72-f1e49544441d on user@joviandss-2#joviandss-2 {{(pid=73579) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] New image-volume cache entry created: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 41, 24, 292704)}. {{(pid=73579) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 28.606s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Marking volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Creating volume glance metadata for volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e905e73-a5f5-4d36-aa58-cb497481a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f6bc8e-c369-4078-a8b0-fa164e56a994', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9abafe-ed49-4d8b-86cd-7afe14b4e476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Volume volume-63f6bc8e-c369-4078-a8b0-fa164e56a994 (63f6bc8e-c369-4078-a8b0-fa164e56a994): created successfully Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9abafe-ed49-4d8b-86cd-7afe14b4e476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (31352ac8-b31e-471a-a44a-58b9d054c685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-948c9171-d50c-48f0-8476-273cf0416d5a tempest-VolumesCloneTest-1516666478 None] Created volume successfully. Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 22.609s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 41, 24, 821823)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 41, 24, 837771)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] create snapshot v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2788e15b-59a0-4671-b9f5-37f887524ec5', 'is_clone': False, 'name': 'v_2788e15b-59a0-4671-b9f5-37f887524ec5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88367075-e8ac-46f5-85e4-b8ccdcbfe933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2788e15b-59a0-4671-b9f5-37f887524ec5', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c83d1c-bc0d-4b98-aa91-2d8852d497b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:25 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Volume volume-2788e15b-59a0-4671-b9f5-37f887524ec5 (2788e15b-59a0-4671-b9f5-37f887524ec5): created successfully Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c83d1c-bc0d-4b98-aa91-2d8852d497b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Flow 'volume_create_manager' (8753aeec-273c-4a8a-9875-b081262d5a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-29230ada-13a2-407f-b51c-a02fcb2556e4 tempest-VolumesListAdminTestJSON-158510996 None] Created volume successfully. Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 4.164s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 41, 25, 88350)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 41, 25, 101728)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] create snapshot v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (2703d636-a7cb-451b-a0ec-35022b255302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a485f643-016f-428d-8127-f288d92440e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a485f643-016f-428d-8127-f288d92440e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1458016967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=555f5085-fb94-40d9-8555-b5368439882f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=63f6bc8e-c369-4078-a8b0-fa164e56a994,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:26Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f459d8-292d-48b8-b222-2aebbc79fbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f459d8-292d-48b8-b222-2aebbc79fbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9855091c-9b5b-4e51-9b5c-8021fa66f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9855091c-9b5b-4e51-9b5c-8021fa66f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '555f5085-fb94-40d9-8555-b5368439882f', 'volume_name': 'volume-555f5085-fb94-40d9-8555-b5368439882f', 'volume_size': 1, 'source_volid': '63f6bc8e-c369-4078-a8b0-fa164e56a994', 'source_volstatus': 'available'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c124ab-6aa5-4f1c-b0f1-617f3dd77dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c124ab-6aa5-4f1c-b0f1-617f3dd77dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3166d67-cfe8-4637-88ac-9eda225b774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:25 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Volume 555f5085-fb94-40d9-8555-b5368439882f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-555f5085-fb94-40d9-8555-b5368439882f', 'volume_size': 1, 'source_volid': '63f6bc8e-c369-4078-a8b0-fa164e56a994', 'source_volstatus': 'available'} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] cloned volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 to 555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] cloning v_63f6bc8e-c369-4078-a8b0-fa164e56a994 to v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] create snapshot v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_5e9b1e2c-15a4-481a-a713-fa24dca0918e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] create volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e from snapshot v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_85e3b47d-db41-4513-a049-843717ef8f86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] create volume v_85e3b47d-db41-4513-a049-843717ef8f86 from snapshot v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Flow 'volume_create_manager' (88f40059-547a-4fa3-a324-63ed8209e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33866521-aa09-4f9f-a87c-9b126f50d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:DELETE=3,cinder:SELECT=60,cinder:UPDATE=25,cinder:INSERT=12 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33866521-aa09-4f9f-a87c-9b126f50d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1733135434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cdd5b344-e9d4-4e56-b3af-abedbef7aa94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735f307ed61e412c9f19df63012f0b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:27Z,use_quota=True,user_id='b8366ee00ca849878fb59e62747c9f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7900c2c4-0526-450b-b356-04db470bffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7900c2c4-0526-450b-b356-04db470bffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06196c90-48c2-4d96-a45b-c18455fd1a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06196c90-48c2-4d96-a45b-c18455fd1a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'volume_name': 'volume-cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a0919d-214b-4f0e-b5b9-9a7819827c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a0919d-214b-4f0e-b5b9-9a7819827c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00558f00-902d-4531-893b-428fbc8ec228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:26 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Volume cdd5b344-e9d4-4e56-b3af-abedbef7aa94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'volume_size': 1} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] creating volume v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] create volume {'name': 'v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_555f5085-fb94-40d9-8555-b5368439882f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] create volume v_555f5085-fb94-40d9-8555-b5368439882f from snapshot v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'is_clone': True, 'full_name': 'Pool-0/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'name': 'v_5e9b1e2c-15a4-481a-a713-fa24dca0918e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] get volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437895', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110254', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5424910070308888832', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8f9b731f51931d7a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314944512', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81441', 'name': 'v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Marking volume 5e9b1e2c-15a4-481a-a713-fa24dca0918e as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 5e9b1e2c-15a4-481a-a713-fa24dca0918e. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Creating volume glance metadata for volume 5e9b1e2c-15a4-481a-a713-fa24dca0918e backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c5f14a-0431-4986-98e7-7194f6e281fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b29ad89-b1f8-49a9-956e-7f56816ad1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:27 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Volume volume-5e9b1e2c-15a4-481a-a713-fa24dca0918e (5e9b1e2c-15a4-481a-a713-fa24dca0918e): created successfully Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b29ad89-b1f8-49a9-956e-7f56816ad1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Flow 'volume_create_manager' (215c2d34-15f0-4989-95e9-50a603142bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b5afaa82-6ca6-4ef1-9b40-d642eec7ead4 tempest-TaggedBootDevicesTest-135372045 None] Created volume successfully. Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_85e3b47d-db41-4513-a049-843717ef8f86', 'is_clone': True, 'full_name': 'Pool-0/v_85e3b47d-db41-4513-a049-843717ef8f86', 'name': 'v_85e3b47d-db41-4513-a049-843717ef8f86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] get volume v_85e3b47d-db41-4513-a049-843717ef8f86 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_85e3b47d-db41-4513-a049-843717ef8f86', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_85e3b47d-db41-4513-a049-843717ef8f86', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437896', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110258', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1069264549427151842', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '20ae9869010ef237', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314817536', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81455', 'name': 'v_85e3b47d-db41-4513-a049-843717ef8f86', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Marking volume 85e3b47d-db41-4513-a049-843717ef8f86 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 85e3b47d-db41-4513-a049-843717ef8f86. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Creating volume glance metadata for volume 85e3b47d-db41-4513-a049-843717ef8f86 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e022a0fa-7152-4667-92bf-326180076ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e3b47d-db41-4513-a049-843717ef8f86', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f285b214-eb17-44b0-937f-ee15102af4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:27 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Volume volume-85e3b47d-db41-4513-a049-843717ef8f86 (85e3b47d-db41-4513-a049-843717ef8f86): created successfully Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f285b214-eb17-44b0-937f-ee15102af4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Flow 'volume_create_manager' (425d3329-5359-46d6-82e1-d57ba1fc6ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7dd4f92f-2db6-459f-9086-5cc6ba7d6459 tempest-VolumesImageMetadata-1568752924 None] Created volume successfully. Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'is_clone': False, 'name': 'v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00558f00-902d-4531-893b-428fbc8ec228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794e0c39-3c0d-453f-8040-4ade41827b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:27 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Volume volume-cdd5b344-e9d4-4e56-b3af-abedbef7aa94 (cdd5b344-e9d4-4e56-b3af-abedbef7aa94): created successfully Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794e0c39-3c0d-453f-8040-4ade41827b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Flow 'volume_create_manager' (88f40059-547a-4fa3-a324-63ed8209e919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-879f90cf-099a-4896-a859-616f07cfb905 tempest-VolumesListAdminTestJSON-158510996 None] Created volume successfully. Apr 14 01:41:27 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=64,cinder:INSERT=22,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_63f6bc8e-c369-4078-a8b0-fa164e56a994@v_555f5085-fb94-40d9-8555-b5368439882f', 'is_clone': True, 'full_name': 'Pool-0/v_555f5085-fb94-40d9-8555-b5368439882f', 'name': 'v_555f5085-fb94-40d9-8555-b5368439882f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] get volume v_555f5085-fb94-40d9-8555-b5368439882f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_63f6bc8e-c369-4078-a8b0-fa164e56a994@v_555f5085-fb94-40d9-8555-b5368439882f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_555f5085-fb94-40d9-8555-b5368439882f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437896', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110262', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '425534844237957922', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '104f143d74bb1974', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314792960', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '81466', 'name': 'v_555f5085-fb94-40d9-8555-b5368439882f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Marking volume 555f5085-fb94-40d9-8555-b5368439882f as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Copying metadata from source volume 63f6bc8e-c369-4078-a8b0-fa164e56a994 to 555f5085-fb94-40d9-8555-b5368439882f. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3166d67-cfe8-4637-88ac-9eda225b774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555f5085-fb94-40d9-8555-b5368439882f', 'volume_size': 1, 'source_volid': '63f6bc8e-c369-4078-a8b0-fa164e56a994', 'source_volstatus': 'available'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c80a1ad-1bbf-422f-a80f-00eaa89d078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:28 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Volume volume-555f5085-fb94-40d9-8555-b5368439882f (555f5085-fb94-40d9-8555-b5368439882f): created successfully Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c80a1ad-1bbf-422f-a80f-00eaa89d078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (2703d636-a7cb-451b-a0ec-35022b255302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6011abd9-ed69-49b2-aad6-d49cb52dfa5c tempest-VolumesCloneTest-1516666478 None] Created volume successfully. Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Acquiring lock "cinder-85e3b47d-db41-4513-a049-843717ef8f86-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Lock "cinder-85e3b47d-db41-4513-a049-843717ef8f86-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] remove_export for volume: 85e3b47d-db41-4513-a049-843717ef8f86. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1697010101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=85e3b47d-db41-4513-a049-843717ef8f86,launched_at=2023-04-14T01:41:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ab28c9ab6a4261bd23d8e38b430304',provider_auth='CHAP KTnAVORb NwIBaMKP8GTUcb',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:20Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:28Z,updated_at=2023-04-14T01:41:28Z,use_quota=True,user_id='b0c54e2fdd324e109d8eed547b39dc43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] detach volume v_85e3b47d-db41-4513-a049-843717ef8f86 from target iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86/luns/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86/luns/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86/luns/v_85e3b47d-db41-4513-a049-843717ef8f86'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86/luns/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] failed to remove resource iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 because of JDSS resource v_85e3b47d-db41-4513-a049-843717ef8f86 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] delete target: iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] delete target iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Flow 'volume_create_manager' (9b587591-c9ce-4631-b8a6-ac067c064794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516c80b0-9010-4e88-9d58-cc8cdd634b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] failed to remove resource iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 because of JDSS resource iqn.2010-10.org.openstack:85e3b47d-db41-4513-a049-843717ef8f86 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] deleating volume v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] get snapshots for volume v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516c80b0-9010-4e88-9d58-cc8cdd634b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-137866865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=953520b1-6ecb-41ad-8793-851901048f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:29Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378d30f5-1235-4dc7-af12-5e54841491a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378d30f5-1235-4dc7-af12-5e54841491a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e591aa-aff0-44ac-8150-40acd0608980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e591aa-aff0-44ac-8150-40acd0608980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953520b1-6ecb-41ad-8793-851901048f6d', 'volume_name': 'volume-953520b1-6ecb-41ad-8793-851901048f6d', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ae6ee0-734f-4a07-8157-21eca9677960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ae6ee0-734f-4a07-8157-21eca9677960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc19285-9642-4b88-b44b-0cc046b03a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:28 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Volume 953520b1-6ecb-41ad-8793-851901048f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953520b1-6ecb-41ad-8793-851901048f6d', 'volume_size': 1} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] creating volume v_953520b1-6ecb-41ad-8793-851901048f6d. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] create volume {'name': 'v_953520b1-6ecb-41ad-8793-851901048f6d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Acquiring lock "cinder-555f5085-fb94-40d9-8555-b5368439882f-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Lock "cinder-555f5085-fb94-40d9-8555-b5368439882f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] remove_export for volume: 555f5085-fb94-40d9-8555-b5368439882f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1458016967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=555f5085-fb94-40d9-8555-b5368439882f,launched_at=2023-04-14T01:41:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth='CHAP NhVepnsu A3LCGBFZio5csy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:26Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=63f6bc8e-c369-4078-a8b0-fa164e56a994,status='deleting',terminated_at=2023-04-14T01:41:29Z,updated_at=2023-04-14T01:41:29Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] detach volume v_555f5085-fb94-40d9-8555-b5368439882f from target iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f/luns/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f/luns/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f/luns/v_555f5085-fb94-40d9-8555-b5368439882f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f/luns/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f because of JDSS resource v_555f5085-fb94-40d9-8555-b5368439882f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] delete target: iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] delete target iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] get volume v_85e3b47d-db41-4513-a049-843717ef8f86 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f because of JDSS resource iqn.2010-10.org.openstack:555f5085-fb94-40d9-8555-b5368439882f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] deleating volume v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] get snapshots for volume v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_85e3b47d-db41-4513-a049-843717ef8f86', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_85e3b47d-db41-4513-a049-843717ef8f86', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437896', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110258', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1069264549427151842', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '20ae9869010ef237', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314698752', 'san:volume_id': '20ae9869010ef2372250d5dca54a0da8bb20362c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81455', 'name': 'v_85e3b47d-db41-4513-a049-843717ef8f86', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] delete snapshot v_85e3b47d-db41-4513-a049-843717ef8f86 of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Flow 'volume_create_manager' (71606566-ade2-436d-a3aa-fe5a80caf7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bd3df5-4459-4afe-a953-f3b36beef0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bd3df5-4459-4afe-a953-f3b36beef0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1272e458-d72e-42f5-87ba-4fb799e028fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3aec592d3d14736b2383053223efa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:30Z,use_quota=True,user_id='5f1980f001ee4e5bb05d81a72fe83cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac093d9-0023-4350-b701-06e550c22acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac093d9-0023-4350-b701-06e550c22acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73edfe7a-f745-40f3-b601-c1afea75d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73edfe7a-f745-40f3-b601-c1afea75d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1272e458-d72e-42f5-87ba-4fb799e028fb', 'volume_name': 'volume-1272e458-d72e-42f5-87ba-4fb799e028fb', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effcbd17-0581-4039-9716-470ddb71b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effcbd17-0581-4039-9716-470ddb71b72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b2f956-56b0-4e72-aab5-4f5a34cab148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Volume 1272e458-d72e-42f5-87ba-4fb799e028fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1272e458-d72e-42f5-87ba-4fb799e028fb', 'volume_size': 1} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] creating volume v_1272e458-d72e-42f5-87ba-4fb799e028fb. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] create volume {'name': 'v_1272e458-d72e-42f5-87ba-4fb799e028fb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_953520b1-6ecb-41ad-8793-851901048f6d', 'is_clone': False, 'name': 'v_953520b1-6ecb-41ad-8793-851901048f6d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc19285-9642-4b88-b44b-0cc046b03a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953520b1-6ecb-41ad-8793-851901048f6d', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9c1447-c668-4627-a0e2-c6ec7297f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Volume volume-953520b1-6ecb-41ad-8793-851901048f6d (953520b1-6ecb-41ad-8793-851901048f6d): created successfully Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9c1447-c668-4627-a0e2-c6ec7297f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Flow 'volume_create_manager' (9b587591-c9ce-4631-b8a6-ac067c064794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:29 user cinder-volume[73579]: INFO cinder.volume.manager [None req-10f98161-f0f4-4eb3-ae33-4fde5b3387b9 tempest-TaggedBootDevicesTest-135372045 None] Created volume successfully. Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] get volume v_555f5085-fb94-40d9-8555-b5368439882f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_63f6bc8e-c369-4078-a8b0-fa164e56a994@v_555f5085-fb94-40d9-8555-b5368439882f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_555f5085-fb94-40d9-8555-b5368439882f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437896', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110262', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '425534844237957922', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '104f143d74bb1974', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314686464', 'san:volume_id': '104f143d74bb19740882ba11887f083f55d5ff63', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '81466', 'name': 'v_555f5085-fb94-40d9-8555-b5368439882f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '8192', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] delete snapshot v_555f5085-fb94-40d9-8555-b5368439882f of volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1272e458-d72e-42f5-87ba-4fb799e028fb', 'is_clone': False, 'name': 'v_1272e458-d72e-42f5-87ba-4fb799e028fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b2f956-56b0-4e72-aab5-4f5a34cab148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1272e458-d72e-42f5-87ba-4fb799e028fb', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c716233e-0ec6-4652-ba79-1468571a2fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Volume volume-1272e458-d72e-42f5-87ba-4fb799e028fb (1272e458-d72e-42f5-87ba-4fb799e028fb): created successfully Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c716233e-0ec6-4652-ba79-1468571a2fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Flow 'volume_create_manager' (71606566-ade2-436d-a3aa-fe5a80caf7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-39e2cfa3-ee63-4849-b795-9d669543b7d9 tempest-VolumesListAdminTestJSON-2047446975 None] Created volume successfully. Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_85e3b47d-db41-4513-a049-843717ef8f86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] snapshot v_85e3b47d-db41-4513-a049-843717ef8f86 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:41:30 user cinder-volume[73579]: DEBUG cinder.quota [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Created reservations ['0d47e3d6-52c0-4335-83c8-5fd49b54eb19', '3de301a6-2c51-4a77-a24f-663008fe9500', 'eb828cbf-1229-4dd6-a46e-a3164bde05ab', 'd93d2c5d-0751-4df5-8437-3b6fbb82f9bd'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331418624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Deleted volume successfully. Apr 14 01:41:31 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=54,cinder:UPDATE=19,cinder:INSERT=21,cinder:DELETE=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Flow 'volume_create_manager' (3e495676-f672-484a-8886-37fac8c55304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eff0ae-4659-4563-bb58-8dfd6681e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.coordination [None req-fc4b6482-e473-4f8e-88d0-61f8736e1546 tempest-VolumesImageMetadata-1568752924 None] Lock "cinder-85e3b47d-db41-4513-a049-843717ef8f86-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eff0ae-4659-4563-bb58-8dfd6681e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1551315636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=da07fe19-d0bc-4451-a0c5-29df607f9b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:31Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6a3547-bda3-4c66-a3ed-8f4e374d1366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6a3547-bda3-4c66-a3ed-8f4e374d1366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1aeb7f5-aa49-46a7-b620-7d212276e36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1aeb7f5-aa49-46a7-b620-7d212276e36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da07fe19-d0bc-4451-a0c5-29df607f9b02', 'volume_name': 'volume-da07fe19-d0bc-4451-a0c5-29df607f9b02', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9020b16e-0d72-4f34-926e-98c9c19fdc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9020b16e-0d72-4f34-926e-98c9c19fdc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b048942-b8f1-4b04-a1bb-97aa6dfb412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:31 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Volume da07fe19-d0bc-4451-a0c5-29df607f9b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da07fe19-d0bc-4451-a0c5-29df607f9b02', 'volume_size': 1} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] creating volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] create volume {'name': 'v_da07fe19-d0bc-4451-a0c5-29df607f9b02', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114314641408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots/v_555f5085-fb94-40d9-8555-b5368439882f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] snapshot v_555f5085-fb94-40d9-8555-b5368439882f deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.quota [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Created reservations ['0f771a41-e3f4-48fe-a01b-60eda25c4afc', 'af855148-1aec-4920-ac76-848d039f38a9', '1bd40ea7-60bc-4420-902c-e240f8a50862', 'e653201c-7747-41f2-b5bc-c35bf2ab16d0'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Acquiring lock "cinder-1272e458-d72e-42f5-87ba-4fb799e028fb-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Lock "cinder-1272e458-d72e-42f5-87ba-4fb799e028fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] remove_export for volume: 1272e458-d72e-42f5-87ba-4fb799e028fb. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1272e458-d72e-42f5-87ba-4fb799e028fb,launched_at=2023-04-14T01:41:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3aec592d3d14736b2383053223efa43',provider_auth='CHAP drVquKCZ 1S0tKaCH7MOEXW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:30Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:32Z,updated_at=2023-04-14T01:41:32Z,use_quota=True,user_id='5f1980f001ee4e5bb05d81a72fe83cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] detach volume v_1272e458-d72e-42f5-87ba-4fb799e028fb from target iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb/luns/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb/luns/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb/luns/v_1272e458-d72e-42f5-87ba-4fb799e028fb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb/luns/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] failed to remove resource iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb because of JDSS resource v_1272e458-d72e-42f5-87ba-4fb799e028fb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] delete target: iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] delete target iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Acquiring lock "cinder-cdd5b344-e9d4-4e56-b3af-abedbef7aa94-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Lock "cinder-cdd5b344-e9d4-4e56-b3af-abedbef7aa94-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_da07fe19-d0bc-4451-a0c5-29df607f9b02', 'is_clone': False, 'name': 'v_da07fe19-d0bc-4451-a0c5-29df607f9b02'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] failed to remove resource iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb because of JDSS resource iqn.2010-10.org.openstack:1272e458-d72e-42f5-87ba-4fb799e028fb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] deleating volume v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] get snapshots for volume v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b048942-b8f1-4b04-a1bb-97aa6dfb412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da07fe19-d0bc-4451-a0c5-29df607f9b02', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2876f346-b5d6-4a95-a5e6-9ad675895442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:32 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Volume volume-da07fe19-d0bc-4451-a0c5-29df607f9b02 (da07fe19-d0bc-4451-a0c5-29df607f9b02): created successfully Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2876f346-b5d6-4a95-a5e6-9ad675895442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Flow 'volume_create_manager' (3e495676-f672-484a-8886-37fac8c55304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:32 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cde15f52-1f18-47d3-826c-19b0dc1bf19d tempest-TaggedBootDevicesTest-135372045 None] Created volume successfully. Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Acquiring lock "cinder-63f6bc8e-c369-4078-a8b0-fa164e56a994-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] remove_export for volume: cdd5b344-e9d4-4e56-b3af-abedbef7aa94. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1733135434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cdd5b344-e9d4-4e56-b3af-abedbef7aa94,launched_at=2023-04-14T01:41:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735f307ed61e412c9f19df63012f0b79',provider_auth='CHAP IhdGMgai vs8IdFXDMTmAQk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:27Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:32Z,updated_at=2023-04-14T01:41:32Z,use_quota=True,user_id='b8366ee00ca849878fb59e62747c9f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] detach volume v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 from target iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94/luns/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94/luns/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Lock "cinder-63f6bc8e-c369-4078-a8b0-fa164e56a994-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94/luns/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94/luns/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] failed to remove resource iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 because of JDSS resource v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] delete target: iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] delete target iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] failed to remove resource iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 because of JDSS resource iqn.2010-10.org.openstack:cdd5b344-e9d4-4e56-b3af-abedbef7aa94 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] deleating volume v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] get snapshots for volume v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] remove_export for volume: 63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1585672458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=63f6bc8e-c369-4078-a8b0-fa164e56a994,launched_at=2023-04-14T01:41:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth='CHAP eygELFHt JfdMsL64gVxoTr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:40:55Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:33Z,updated_at=2023-04-14T01:41:33Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] detach volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994 from target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns/v_63f6bc8e-c369-4078-a8b0-fa164e56a994'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994/luns/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 because of JDSS resource v_63f6bc8e-c369-4078-a8b0-fa164e56a994 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] delete target: iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] delete target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 because of JDSS resource iqn.2010-10.org.openstack:63f6bc8e-c369-4078-a8b0-fa164e56a994 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] deleating volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] get snapshots for volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314579968', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.manager [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:33 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Deleted volume successfully. Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6696221a-c493-453f-8879-2fc89a804579 tempest-VolumesCloneTest-1516666478 None] Lock "cinder-555f5085-fb94-40d9-8555-b5368439882f-delete_volume" released by "delete_volume" :: held 3.965s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] get volume v_1272e458-d72e-42f5-87ba-4fb799e028fb info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1272e458-d72e-42f5-87ba-4fb799e028fb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437899', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110275', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '772684544180034874', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bc866446c202fbb1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314567680', 'san:volume_id': 'bc866446c202fbb16dc9f993fe27b12852e109e2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81498', 'name': 'v_1272e458-d72e-42f5-87ba-4fb799e028fb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] delete volume:v_1272e458-d72e-42f5-87ba-4fb799e028fb recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] get volume v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437896', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110265', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4425507549610480849', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cb9dad31f744f2e6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314567680', 'san:volume_id': 'cb9dad31f744f2e69b485ce83c72d7dca3ad46ec', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81479', 'name': 'v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] delete volume:v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '16285696', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 04:04:51', 'volsize': '1073741824', 'createtxg': '110239', 'guid': '10418667870450804303', 'compressratio': '1.17', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '16285696', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.17', 'fscontext': 'none', 'clones': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'objsetid': '81858', 'name': 'v_ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'defer_destroy': 'off', 'san:volume_id': '21b88974b0e44e6a6b530b1269ec3eddae810c25', 'mlslabel': 'none', 'logicalreferenced': '19042304', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63f6bc8e-c369-4078-a8b0-fa164e56a994 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] volume v_63f6bc8e-c369-4078-a8b0-fa164e56a994 updated {{(pid=73579) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=29,cinder:SELECT=58,cinder:INSERT=11,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.quota [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Created reservations ['5f23010a-994f-4e44-9abb-bf39cf2cb0f0', 'fc090e8a-e01e-4f2a-a439-5255189c3ca2', '58f358a0-204f-41ad-9b62-5f6d28fd5956', '927d6cdf-88d1-4191-a7d0-7486484a3858'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1272e458-d72e-42f5-87ba-4fb799e028fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] volume v_1272e458-d72e-42f5-87ba-4fb799e028fb deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] volume v_cdd5b344-e9d4-4e56-b3af-abedbef7aa94 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.quota [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Created reservations ['6e1f8b7b-781f-46da-8823-937a94813e99', '9efc72c0-441c-4e9f-afec-891a651dbbf8', '84faa295-8d24-40ae-9c85-fe066de3af6c', '76fc977d-1e57-4786-8e25-0616dbe3ca2f'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.quota [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Created reservations ['bc51fe5e-afb1-4888-9e1c-1e7faad74526', '08b78e10-137c-4895-aae7-e182a7988f19', '3877c5b0-de67-4881-b891-a8985bd48293', 'b1382f2c-fbe0-4fa5-91a1-1150453c66ef'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314579968', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.manager [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:35 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Deleted volume successfully. Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314579968', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.manager [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2e9bdab7-3691-486a-b46f-cc238f70e233 tempest-VolumesListAdminTestJSON-2047446975 None] Lock "cinder-1272e458-d72e-42f5-87ba-4fb799e028fb-delete_volume" released by "delete_volume" :: held 3.723s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:35 user cinder-volume[73579]: INFO cinder.volume.manager [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Deleted volume successfully. Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-04c76e80-e2a6-41a9-8653-1d710d5b3164 tempest-VolumesListAdminTestJSON-158510996 None] Lock "cinder-cdd5b344-e9d4-4e56-b3af-abedbef7aa94-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Acquiring lock "cinder-2788e15b-59a0-4671-b9f5-37f887524ec5-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Lock "cinder-2788e15b-59a0-4671-b9f5-37f887524ec5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] remove_export for volume: 2788e15b-59a0-4671-b9f5-37f887524ec5. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952514930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2788e15b-59a0-4671-b9f5-37f887524ec5,launched_at=2023-04-14T01:41:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735f307ed61e412c9f19df63012f0b79',provider_auth='CHAP cCnHzLtv XmLvp8Sl4Dsge2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:36Z,updated_at=2023-04-14T01:41:36Z,use_quota=True,user_id='b8366ee00ca849878fb59e62747c9f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] detach volume v_2788e15b-59a0-4671-b9f5-37f887524ec5 from target iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5/luns/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5/luns/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5/luns/v_2788e15b-59a0-4671-b9f5-37f887524ec5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5/luns/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] failed to remove resource iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 because of JDSS resource v_2788e15b-59a0-4671-b9f5-37f887524ec5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] delete target: iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] delete target iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] failed to remove resource iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 because of JDSS resource iqn.2010-10.org.openstack:2788e15b-59a0-4671-b9f5-37f887524ec5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] deleating volume v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] get snapshots for volume v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314731520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.manager [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:36 user cinder-volume[73579]: INFO cinder.volume.manager [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Deleted volume successfully. Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-18bd9134-a9ee-48bf-9a72-cf9d9c6383ed tempest-VolumesCloneTest-1516666478 None] Lock "cinder-63f6bc8e-c369-4078-a8b0-fa164e56a994-delete_volume" released by "delete_volume" :: held 3.745s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (0f36f442-9ab3-4d65-939f-da9e8ab68b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7434b4-1f70-4969-9a46-7d4accfc9972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7434b4-1f70-4969-9a46-7d4accfc9972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-640214409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e1498f89-6e76-4f77-826e-a36e62c8ba09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:36Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659fcded-f997-49bb-bb0c-1c394e33d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659fcded-f997-49bb-bb0c-1c394e33d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5262d14-1688-4048-b204-da2878ea940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5262d14-1688-4048-b204-da2878ea940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1498f89-6e76-4f77-826e-a36e62c8ba09', 'volume_name': 'volume-e1498f89-6e76-4f77-826e-a36e62c8ba09', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37b0566-98cf-4a1f-a7bc-5deda06c1de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37b0566-98cf-4a1f-a7bc-5deda06c1de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6590f9-b71c-4867-98f6-78352f637cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:36 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Volume e1498f89-6e76-4f77-826e-a36e62c8ba09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1498f89-6e76-4f77-826e-a36e62c8ba09', 'volume_size': 1} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] creating volume v_e1498f89-6e76-4f77-826e-a36e62c8ba09. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] create volume {'name': 'v_e1498f89-6e76-4f77-826e-a36e62c8ba09', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] get volume v_2788e15b-59a0-4671-b9f5-37f887524ec5 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2788e15b-59a0-4671-b9f5-37f887524ec5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437893', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110245', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10587182738529910250', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '987541e8c70a3324', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314731520', 'san:volume_id': '987541e8c70a332457c3efacdbbce6541f45714b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81879', 'name': 'v_2788e15b-59a0-4671-b9f5-37f887524ec5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] delete volume:v_2788e15b-59a0-4671-b9f5-37f887524ec5 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Flow 'volume_create_manager' (e806eeb6-dbb0-46ab-b5c3-fa15f833bd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fba06a-4300-4888-8f71-82168a30d0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=51,cinder:INSERT=6,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fba06a-4300-4888-8f71-82168a30d0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1089808248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=89c8dc10-871a-4bd0-a4cd-e1460ea5277a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1c3cddfbcb4675b51a74c9ddeb070a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:37Z,use_quota=True,user_id='89dcd1c90fd24a5e8dce6b985f9ba63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de265c48-a19f-4480-bd1d-cd32d2b69951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de265c48-a19f-4480-bd1d-cd32d2b69951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7564095-265d-4964-9749-56080c5fb85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7564095-265d-4964-9749-56080c5fb85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'volume_name': 'volume-89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef525103-6e56-411e-a3d4-02567aaa161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef525103-6e56-411e-a3d4-02567aaa161c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5377499b-5b4e-45fb-afb3-12a154bf69f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:37 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Volume 89c8dc10-871a-4bd0-a4cd-e1460ea5277a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'volume_size': 1} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] creating volume v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] create volume {'name': 'v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e1498f89-6e76-4f77-826e-a36e62c8ba09', 'is_clone': False, 'name': 'v_e1498f89-6e76-4f77-826e-a36e62c8ba09'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6590f9-b71c-4867-98f6-78352f637cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1498f89-6e76-4f77-826e-a36e62c8ba09', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89602ea5-3585-4a24-a738-2627d0280c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:37 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Volume volume-e1498f89-6e76-4f77-826e-a36e62c8ba09 (e1498f89-6e76-4f77-826e-a36e62c8ba09): created successfully Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89602ea5-3585-4a24-a738-2627d0280c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (0f36f442-9ab3-4d65-939f-da9e8ab68b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:37 user cinder-volume[73579]: INFO cinder.volume.manager [None req-80ef629e-0b10-45f4-aca7-bad60ccca662 tempest-VolumesCloneTest-1516666478 None] Created volume successfully. Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'is_clone': False, 'name': 'v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5377499b-5b4e-45fb-afb3-12a154bf69f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49dc200-110e-416d-bcc4-b34451a5a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:38 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Volume volume-89c8dc10-871a-4bd0-a4cd-e1460ea5277a (89c8dc10-871a-4bd0-a4cd-e1460ea5277a): created successfully Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49dc200-110e-416d-bcc4-b34451a5a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Flow 'volume_create_manager' (e806eeb6-dbb0-46ab-b5c3-fa15f833bd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:38 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f203a3bd-8d43-4c8d-beba-4eb91abeac37 tempest-AbsoluteLimitsTests-1603177337 None] Created volume successfully. Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2788e15b-59a0-4671-b9f5-37f887524ec5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] volume v_2788e15b-59a0-4671-b9f5-37f887524ec5 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.quota [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Created reservations ['29bd80ea-fdc5-4c58-9218-db317a43f48b', '13696aac-37f5-4f45-99f2-ae4079e9fab3', 'ac626153-edc0-4785-84fb-de540a385fff', 'b1b3f4c7-073d-4f27-a0b1-f334ab061920'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:38 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (1771a7e9-8f07-4b6b-a919-f32ed42e0a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3d7e58-3418-4b83-8e1d-8a09d604cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3d7e58-3418-4b83-8e1d-8a09d604cf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1424319468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=792bd7a6-06b0-44b4-b77f-fd0f37e33bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e1498f89-6e76-4f77-826e-a36e62c8ba09,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:39Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8efc53-59cb-45d3-bd15-5fee7583e363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8efc53-59cb-45d3-bd15-5fee7583e363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f2fb65-ff99-4121-9d94-5e71b59029b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f2fb65-ff99-4121-9d94-5e71b59029b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'volume_name': 'volume-792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'volume_size': 2, 'source_volid': 'e1498f89-6e76-4f77-826e-a36e62c8ba09', 'source_volstatus': 'available'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a239bbdb-bcb5-42c0-ac5b-1faaba912525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a239bbdb-bcb5-42c0-ac5b-1faaba912525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6172f088-2968-4d2d-b5a6-2eae6077a618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:39 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Volume 792bd7a6-06b0-44b4-b77f-fd0f37e33bc1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'volume_size': 2, 'source_volid': 'e1498f89-6e76-4f77-826e-a36e62c8ba09', 'source_volstatus': 'available'} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314637312', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.manager [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:39 user cinder-volume[73579]: INFO cinder.volume.manager [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Deleted volume successfully. Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] cloned volume e1498f89-6e76-4f77-826e-a36e62c8ba09 to 792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] cloning v_e1498f89-6e76-4f77-826e-a36e62c8ba09 to v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] create snapshot v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-dee11cad-3a8a-40f9-84c4-f885965762b6 tempest-VolumesListAdminTestJSON-158510996 None] Lock "cinder-2788e15b-59a0-4671-b9f5-37f887524ec5-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Acquiring lock "cinder-176af74d-4379-4754-b486-41f3d3aeacc1-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Lock "cinder-176af74d-4379-4754-b486-41f3d3aeacc1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] remove_export for volume: 176af74d-4379-4754-b486-41f3d3aeacc1. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2037849236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=176af74d-4379-4754-b486-41f3d3aeacc1,launched_at=2023-04-14T01:41:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735f307ed61e412c9f19df63012f0b79',provider_auth='CHAP qrdbAgHs pZBvo1UxPLFucC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:21Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:39Z,updated_at=2023-04-14T01:41:39Z,use_quota=True,user_id='b8366ee00ca849878fb59e62747c9f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] detach volume v_176af74d-4379-4754-b486-41f3d3aeacc1 from target iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1/luns/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1/luns/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Acquiring lock "cinder-89c8dc10-871a-4bd0-a4cd-e1460ea5277a-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Lock "cinder-89c8dc10-871a-4bd0-a4cd-e1460ea5277a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1/luns/v_176af74d-4379-4754-b486-41f3d3aeacc1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1/luns/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] failed to remove resource iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 because of JDSS resource v_176af74d-4379-4754-b486-41f3d3aeacc1 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] delete target: iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] delete target iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=30,cinder:SELECT=58,cinder:INSERT=11,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] failed to remove resource iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 because of JDSS resource iqn.2010-10.org.openstack:176af74d-4379-4754-b486-41f3d3aeacc1 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] deleating volume v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] get snapshots for volume v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] remove_export for volume: 89c8dc10-871a-4bd0-a4cd-e1460ea5277a. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1089808248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=89c8dc10-871a-4bd0-a4cd-e1460ea5277a,launched_at=2023-04-14T01:41:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1c3cddfbcb4675b51a74c9ddeb070a',provider_auth='CHAP gwzIMYSm PpzAS9l7Oq6Wvh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:37Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:39Z,updated_at=2023-04-14T01:41:39Z,use_quota=True,user_id='89dcd1c90fd24a5e8dce6b985f9ba63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] detach volume v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a from target iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a/luns/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a/luns/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a/luns/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a/luns/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] failed to remove resource iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a because of JDSS resource v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] delete target: iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] delete target iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] failed to remove resource iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a because of JDSS resource iqn.2010-10.org.openstack:89c8dc10-871a-4bd0-a4cd-e1460ea5277a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] deleating volume v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] get snapshots for volume v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] get volume v_176af74d-4379-4754-b486-41f3d3aeacc1 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_176af74d-4379-4754-b486-41f3d3aeacc1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437891', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110236', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12480559997451245201', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '117a4eb4d5effdef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314637312', 'san:volume_id': '117a4eb4d5effdeff83c40298625602d975986ab', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81853', 'name': 'v_176af74d-4379-4754-b486-41f3d3aeacc1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] delete volume:v_176af74d-4379-4754-b486-41f3d3aeacc1 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] get volume v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437907', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110295', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18340626948337512584', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '63ad12290638b871', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314637312', 'san:volume_id': '63ad12290638b871e64ee274a7380ab4a31c852f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81734', 'name': 'v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] delete volume:v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] create volume v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 from snapshot v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e1498f89-6e76-4f77-826e-a36e62c8ba09@v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'is_clone': True, 'full_name': 'Pool-0/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'name': 'v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] get volume v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e1498f89-6e76-4f77-826e-a36e62c8ba09@v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437909', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110302', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5046970765473433077', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5a6e9438d3a39171', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314625024', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81749', 'name': 'v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Extend volume 792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] jdss extend volume v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 to 2147483648 {{(pid=73579) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6172f088-2968-4d2d-b5a6-2eae6077a618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'volume_size': 2, 'source_volid': 'e1498f89-6e76-4f77-826e-a36e62c8ba09', 'source_volstatus': 'available'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c40d6a0-bf51-4cf7-a396-afab4e0d523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:41 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Volume volume-792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 (792bd7a6-06b0-44b4-b77f-fd0f37e33bc1): created successfully Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c40d6a0-bf51-4cf7-a396-afab4e0d523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Flow 'volume_create_manager' (1771a7e9-8f07-4b6b-a919-f32ed42e0a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:41 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d5fe3460-0823-403d-bdae-d24af6a5d2f3 tempest-VolumesCloneTest-1516666478 None] Created volume successfully. Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_176af74d-4379-4754-b486-41f3d3aeacc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] volume v_176af74d-4379-4754-b486-41f3d3aeacc1 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] volume v_89c8dc10-871a-4bd0-a4cd-e1460ea5277a deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.quota [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Created reservations ['08c07587-7e5b-4bb8-b7fd-790fa4865a3a', '8516e9c2-a020-43f3-bcc3-d7d33805cd06', '1f190384-9b0a-4719-b58c-a88d87eece03', '89f0445a-6574-4cd4-acb6-773a9cad7dea'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.quota [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Created reservations ['2b736d18-4698-42d7-b4e0-65e4ba28177a', '1c57f151-e579-4b52-8055-36c95bc8954d', 'b7cc87b2-f610-4d55-97ce-29d9335f37cc', 'aad2b268-32cd-4c6b-b4c0-83f319f0a738'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314637312', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.manager [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Deleted volume successfully. Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-39cf10f8-ee1f-4c08-b55b-569a150bc9c7 tempest-AbsoluteLimitsTests-1603177337 None] Lock "cinder-89c8dc10-871a-4bd0-a4cd-e1460ea5277a-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Acquiring lock "cinder-792bd7a6-06b0-44b4-b77f-fd0f37e33bc1-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Lock "cinder-792bd7a6-06b0-44b4-b77f-fd0f37e33bc1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] remove_export for volume: 792bd7a6-06b0-44b4-b77f-fd0f37e33bc1. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1424319468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=792bd7a6-06b0-44b4-b77f-fd0f37e33bc1,launched_at=2023-04-14T01:41:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth='CHAP kpueORrS cZxIf7pwkb3TQP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:39Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e1498f89-6e76-4f77-826e-a36e62c8ba09,status='deleting',terminated_at=2023-04-14T01:41:42Z,updated_at=2023-04-14T01:41:42Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] detach volume v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 from target iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1/luns/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1/luns/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1/luns/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1/luns/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 because of JDSS resource v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] delete target: iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] delete target iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 because of JDSS resource iqn.2010-10.org.openstack:792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] deleating volume v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] get snapshots for volume v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314694656', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.manager [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Deleted volume successfully. Apr 14 01:41:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-716e5e5a-af88-4ae2-b553-69395d80ad78 tempest-VolumesListAdminTestJSON-158510996 None] Lock "cinder-176af74d-4379-4754-b486-41f3d3aeacc1-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] get volume v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e1498f89-6e76-4f77-826e-a36e62c8ba09@v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437909', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110302', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5046970765473433077', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5a6e9438d3a39171', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314694656', 'san:volume_id': '5a6e9438d3a39171c5dbca8fc56b7eacf25471cc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81749', 'name': 'v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] delete snapshot v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 of volume v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots/v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] snapshot v_792bd7a6-06b0-44b4-b77f-fd0f37e33bc1 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG cinder.quota [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Created reservations ['f22a61d7-72e4-4182-8e39-7c21b7fc921e', 'f5197445-cf04-4b86-92da-fe89686fcb90', '8be25f2a-9bf1-47a6-b38a-6e28c27c53fb', '3cc7b3ea-2a5b-4716-a4bd-b7a6a00b0218'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=55,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314776576', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.manager [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:45 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Deleted volume successfully. Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2756d4eb-cdea-4d1d-b4ae-9bb26cf2767f tempest-VolumesCloneTest-1516666478 None] Lock "cinder-792bd7a6-06b0-44b4-b77f-fd0f37e33bc1-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.coordination [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Acquiring lock "cinder-e1498f89-6e76-4f77-826e-a36e62c8ba09-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.coordination [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Lock "cinder-e1498f89-6e76-4f77-826e-a36e62c8ba09-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] remove_export for volume: e1498f89-6e76-4f77-826e-a36e62c8ba09. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-640214409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e1498f89-6e76-4f77-826e-a36e62c8ba09,launched_at=2023-04-14T01:41:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f65d89c5c9460e8cbb86164bb2a436',provider_auth='CHAP FAtwIYjg KaGb9pPI07rqdY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:36Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:46Z,updated_at=2023-04-14T01:41:46Z,use_quota=True,user_id='b3255f4b4cbe40a589cfc5a1dff7dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] detach volume v_e1498f89-6e76-4f77-826e-a36e62c8ba09 from target iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09/luns/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09/luns/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09/luns/v_e1498f89-6e76-4f77-826e-a36e62c8ba09'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09/luns/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 because of JDSS resource v_e1498f89-6e76-4f77-826e-a36e62c8ba09 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] delete target: iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] delete target iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] failed to remove resource iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 because of JDSS resource iqn.2010-10.org.openstack:e1498f89-6e76-4f77-826e-a36e62c8ba09 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] deleating volume v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] get snapshots for volume v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] get volume v_e1498f89-6e76-4f77-826e-a36e62c8ba09 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e1498f89-6e76-4f77-826e-a36e62c8ba09', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437906', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110291', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4130434923657529302', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '663ed57f1a9a7148', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314776576', 'san:volume_id': '663ed57f1a9a714807920535a91e75e904c8f88f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81886', 'name': 'v_e1498f89-6e76-4f77-826e-a36e62c8ba09', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] delete volume:v_e1498f89-6e76-4f77-826e-a36e62c8ba09 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1498f89-6e76-4f77-826e-a36e62c8ba09 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] volume v_e1498f89-6e76-4f77-826e-a36e62c8ba09 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Flow 'volume_create_manager' (5d42bc91-2bdb-4cdf-b64f-7b4a4925a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e33a766-56b1-40a6-9ce6-636903055245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e33a766-56b1-40a6-9ce6-636903055245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030025018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb176ac656c47b38e736fc629fc46e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:48Z,use_quota=True,user_id='8b18b911fcf847efbf4f814f3b687279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba4d15b-ecbc-4967-b0d2-025210951147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba4d15b-ecbc-4967-b0d2-025210951147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a9397-2d8b-4228-9b8a-2f7be77738ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a9397-2d8b-4228-9b8a-2f7be77738ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'volume_name': 'volume-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23d382-57b5-4eb0-a495-95baba78ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23d382-57b5-4eb0-a495-95baba78ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6c5db6-d30b-49db-b312-020b670a451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:48 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'volume_size': 1} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] creating volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] create volume {'name': 'v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.quota [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Created reservations ['cc6bffb0-b4ce-4b09-8fcc-67d0d41b69b2', 'f69dfc2e-e393-42d4-b45c-d5c80cbda2df', '95928e98-266e-4b5a-8e06-1cb85873374c', '3871310c-cd6b-4ff7-b9db-8d4e4aa9ed15'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314870784', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.manager [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Deleted volume successfully. Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.coordination [None req-964afbfd-4955-4edd-b2ce-8c0712511ce6 tempest-VolumesCloneTest-1516666478 None] Lock "cinder-e1498f89-6e76-4f77-826e-a36e62c8ba09-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'is_clone': False, 'name': 'v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6c5db6-d30b-49db-b312-020b670a451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e172ae99-26da-4b66-a2d9-c38986296fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:49 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Volume volume-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f): created successfully Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e172ae99-26da-4b66-a2d9-c38986296fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Flow 'volume_create_manager' (5d42bc91-2bdb-4cdf-b64f-7b4a4925a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-388f23f2-c768-4e7c-9ed5-fec470953f5b tempest-VolumesActionsTest-193871514 None] Created volume successfully. Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] create export for volume: 5e9b1e2c-15a4-481a-a713-fa24dca0918e. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] ensure volume 5e9b1e2c-15a4-481a-a713-fa24dca0918e assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] check if targe iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] create target and attach volume 5e9b1e2c-15a4-481a-a713-fa24dca0918e to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] create target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Flow 'volume_create_manager' (d3054211-77af-430c-97aa-09be6c667dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ff2c18-0429-4852-b1d2-9f9f27d8e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ff2c18-0429-4852-b1d2-9f9f27d8e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1728545852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=35b0df70-67c0-4433-85e7-856b09e5b27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90a5eb6ec8549e2a6d49de1d1c4e6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:41:51Z,use_quota=True,user_id='51413a0a81404e81b92cbf6b70414fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80ba7f1-fc95-4d92-8207-88d135aa17fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80ba7f1-fc95-4d92-8207-88d135aa17fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed1a77b-fc3a-423a-9494-5e763324688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed1a77b-fc3a-423a-9494-5e763324688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35b0df70-67c0-4433-85e7-856b09e5b27a', 'volume_name': 'volume-35b0df70-67c0-4433-85e7-856b09e5b27a', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540cf512-de4b-4f7c-af6a-6c3f35e15465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540cf512-de4b-4f7c-af6a-6c3f35e15465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d02191-e84a-44ce-b17d-670ff33fecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:51 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Volume 35b0df70-67c0-4433-85e7-856b09e5b27a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35b0df70-67c0-4433-85e7-856b09e5b27a', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Cloning 35b0df70-67c0-4433-85e7-856b09e5b27a from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=52,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 41, 51, 675721)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 41, 51, 694973)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] create snapshot v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_35b0df70-67c0-4433-85e7-856b09e5b27a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] create volume v_35b0df70-67c0-4433-85e7-856b09e5b27a from snapshot v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:41:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'is_clone': True, 'full_name': 'Pool-0/v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'name': 'v_35b0df70-67c0-4433-85e7-856b09e5b27a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] get volume v_35b0df70-67c0-4433-85e7-856b09e5b27a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437922', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110319', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4415949151779597773', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '28607ac539c8cd86', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314739712', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81131', 'name': 'v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Marking volume 35b0df70-67c0-4433-85e7-856b09e5b27a as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 35b0df70-67c0-4433-85e7-856b09e5b27a. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Creating volume glance metadata for volume 35b0df70-67c0-4433-85e7-856b09e5b27a backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d02191-e84a-44ce-b17d-670ff33fecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b0df70-67c0-4433-85e7-856b09e5b27a', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659023cf-9179-45f7-a6ea-c365b00590a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:53 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Volume volume-35b0df70-67c0-4433-85e7-856b09e5b27a (35b0df70-67c0-4433-85e7-856b09e5b27a): created successfully Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659023cf-9179-45f7-a6ea-c365b00590a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Flow 'volume_create_manager' (d3054211-77af-430c-97aa-09be6c667dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:53 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e0b2dda2-2095-432c-a0a9-5daf6a44b346 tempest-VolumesExtendTest-405161943 None] Created volume successfully. Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] atach volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e to target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f61487-13bf-4870-bb06-4c0d6cabce08 tempest-VolumesExtendTest-405161943 None] Extend volume 35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f61487-13bf-4870-bb06-4c0d6cabce08 tempest-VolumesExtendTest-405161943 None] jdss extend volume v_35b0df70-67c0-4433-85e7-856b09e5b27a to 2147483648 {{(pid=73579) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f61487-13bf-4870-bb06-4c0d6cabce08 tempest-VolumesExtendTest-405161943 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f61487-13bf-4870-bb06-4c0d6cabce08 tempest-VolumesExtendTest-405161943 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f61487-13bf-4870-bb06-4c0d6cabce08 tempest-VolumesExtendTest-405161943 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:55 user cinder-volume[73579]: INFO cinder.volume.manager [None req-97f61487-13bf-4870-bb06-4c0d6cabce08 tempest-VolumesExtendTest-405161943 None] Extend volume completed successfully. Apr 14 01:41:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3866396237333166', 'lun': 0, 'mode': 'wt', 'name': 'v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'prod_id': 'Storage', 'scsi_id': '8f9b731f51931d7a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] add credentails to target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:41:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Acquiring lock "cinder-35b0df70-67c0-4433-85e7-856b09e5b27a-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Lock "cinder-35b0df70-67c0-4433-85e7-856b09e5b27a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'name': 'oLYPhWbV'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] remove_export for volume: 35b0df70-67c0-4433-85e7-856b09e5b27a. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1728545852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=35b0df70-67c0-4433-85e7-856b09e5b27a,launched_at=2023-04-14T01:41:54Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='c90a5eb6ec8549e2a6d49de1d1c4e6af',provider_auth='CHAP KSMYOqPD rtlOyPfLbKiEnI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:51Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:41:56Z,updated_at=2023-04-14T01:41:56Z,use_quota=True,user_id='51413a0a81404e81b92cbf6b70414fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] detach volume v_35b0df70-67c0-4433-85e7-856b09e5b27a from target iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a/luns/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a/luns/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] initialize_connection for 5e9b1e2c-15a4-481a-a713-fa24dca0918e 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a/luns/v_35b0df70-67c0-4433-85e7-856b09e5b27a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a/luns/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] failed to remove resource iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a because of JDSS resource v_35b0df70-67c0-4433-85e7-856b09e5b27a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] delete target: iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] delete target iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLYPhWbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a2d4b20a-282f-4cf8-b9cb-1bb84bcb8db0'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] failed to remove resource iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a because of JDSS resource iqn.2010-10.org.openstack:35b0df70-67c0-4433-85e7-856b09e5b27a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] deleating volume v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] get snapshots for volume v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:56 user cinder-volume[73579]: INFO cinder.volume.manager [req-8079896e-8521-4c24-9771-0343217a9e1e req-16c0f46d-affe-4649-b5cd-6ce03039f901 tempest-TaggedBootDevicesTest-135372045 None] attachment_update completed successfully. Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] get volume v_35b0df70-67c0-4433-85e7-856b09e5b27a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437922', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110319', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4415949151779597773', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '28607ac539c8cd86', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314645504', 'san:volume_id': '28607ac539c8cd86ff522eed7addd4b67ae783d2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81131', 'name': 'v_35b0df70-67c0-4433-85e7-856b09e5b27a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] delete snapshot v_35b0df70-67c0-4433-85e7-856b09e5b27a of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] create export for volume: 953520b1-6ecb-41ad-8793-851901048f6d. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] ensure volume 953520b1-6ecb-41ad-8793-851901048f6d assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] check if targe iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] create target and attach volume 953520b1-6ecb-41ad-8793-851901048f6d to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] create target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_35b0df70-67c0-4433-85e7-856b09e5b27a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] snapshot v_35b0df70-67c0-4433-85e7-856b09e5b27a deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=68,cinder:DELETE=3,cinder:INSERT=7,cinder:UPDATE=22 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG cinder.quota [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Created reservations ['de023721-3bc7-44fd-8c8f-fafcf9d2a396', '83144671-c13b-4257-bc83-87897ef433cd', 'e833cf28-1acf-4689-a05a-986e11d45ba9', 'b050eebf-2314-40f6-944f-7b6be6c4a06b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314764288', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.manager [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:41:59 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Deleted volume successfully. Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c56ef25-57ba-43e0-a80a-0eb880638b71 tempest-VolumesExtendTest-405161943 None] Lock "cinder-35b0df70-67c0-4433-85e7-856b09e5b27a-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Flow 'volume_create_manager' (3c7bcc99-a010-4004-841e-832e6021ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27143978-5bf2-4fd9-953d-a502fbd0b4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27143978-5bf2-4fd9-953d-a502fbd0b4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-399303551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=08decde3-47e7-4399-87e7-0440cdb9d298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90a5eb6ec8549e2a6d49de1d1c4e6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:42:00Z,use_quota=True,user_id='51413a0a81404e81b92cbf6b70414fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d23212-020a-4be5-a21f-40f6e639ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d23212-020a-4be5-a21f-40f6e639ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05542528-574b-4b4f-b556-42576a9f29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05542528-574b-4b4f-b556-42576a9f29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08decde3-47e7-4399-87e7-0440cdb9d298', 'volume_name': 'volume-08decde3-47e7-4399-87e7-0440cdb9d298', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf19d903-ebc5-4fe4-b8fa-08a5e5ff98ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf19d903-ebc5-4fe4-b8fa-08a5e5ff98ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d536faeb-4510-4f1a-8018-4f19a87d9293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:41:59 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Volume 08decde3-47e7-4399-87e7-0440cdb9d298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08decde3-47e7-4399-87e7-0440cdb9d298', 'volume_size': 1} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] creating volume v_08decde3-47e7-4399-87e7-0440cdb9d298. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] create volume {'name': 'v_08decde3-47e7-4399-87e7-0440cdb9d298', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] atach volume v_953520b1-6ecb-41ad-8793-851901048f6d to target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:41:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_08decde3-47e7-4399-87e7-0440cdb9d298', 'is_clone': False, 'name': 'v_08decde3-47e7-4399-87e7-0440cdb9d298'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d536faeb-4510-4f1a-8018-4f19a87d9293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08decde3-47e7-4399-87e7-0440cdb9d298', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57943dce-9fc2-450e-a5a0-830d05379ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:00 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Volume volume-08decde3-47e7-4399-87e7-0440cdb9d298 (08decde3-47e7-4399-87e7-0440cdb9d298): created successfully Apr 14 01:42:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57943dce-9fc2-450e-a5a0-830d05379ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Flow 'volume_create_manager' (3c7bcc99-a010-4004-841e-832e6021ee27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:00 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fc56e074-ae3c-48bf-83e9-cc35ac6a53ac tempest-VolumesExtendTest-405161943 None] Created volume successfully. Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] create snapshot 2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 for volume 08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] cloning v_08decde3-47e7-4399-87e7-0440cdb9d298 to s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] create snapshot s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6136613633313435', 'lun': 0, 'mode': 'wt', 'name': 'v_953520b1-6ecb-41ad-8793-851901048f6d', 'prod_id': 'Storage', 'scsi_id': 'a6a63145e255a6c6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] add credentails to target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TXlNnZyv'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] initialize_connection for 953520b1-6ecb-41ad-8793-851901048f6d 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:42:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXlNnZyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '382fb1d8-0966-4964-95a3-acafbfaf1d06'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:42:01 user cinder-volume[73579]: INFO cinder.volume.manager [req-8079896e-8521-4c24-9771-0343217a9e1e req-757509be-9a4f-4f2f-9b04-8f54a02ef9ba tempest-TaggedBootDevicesTest-135372045 None] attachment_update completed successfully. Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] create export for volume: da07fe19-d0bc-4451-a0c5-29df607f9b02. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] ensure volume da07fe19-d0bc-4451-a0c5-29df607f9b02 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] check if targe iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] create target and attach volume da07fe19-d0bc-4451-a0c5-29df607f9b02 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] create target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] create volume s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 from snapshot s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_08decde3-47e7-4399-87e7-0440cdb9d298@s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7', 'is_clone': True, 'full_name': 'Pool-0/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7', 'name': 's_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] volume s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:42:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8e017157-fd6a-46ff-958b-232281e3c122 tempest-VolumesExtendTest-405161943 None] Create snapshot completed successfully Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fe4f5a8-83d1-496f-9f62-42f182fc1d92 tempest-VolumesExtendTest-405161943 None] Extend volume 08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fe4f5a8-83d1-496f-9f62-42f182fc1d92 tempest-VolumesExtendTest-405161943 None] jdss extend volume v_08decde3-47e7-4399-87e7-0440cdb9d298 to 2147483648 {{(pid=73579) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fe4f5a8-83d1-496f-9f62-42f182fc1d92 tempest-VolumesExtendTest-405161943 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fe4f5a8-83d1-496f-9f62-42f182fc1d92 tempest-VolumesExtendTest-405161943 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fe4f5a8-83d1-496f-9f62-42f182fc1d92 tempest-VolumesExtendTest-405161943 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6fe4f5a8-83d1-496f-9f62-42f182fc1d92 tempest-VolumesExtendTest-405161943 None] Extend volume completed successfully. Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Flow 'volume_create_manager' (d40744ed-39a0-4877-878f-aa0d5558d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f54ec6-6628-496f-8fd1-dc4d46c20ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f54ec6-6628-496f-8fd1-dc4d46c20ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1954746558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f78596d7-c339-491a-a0d2-470a1c158a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:42:05Z,use_quota=True,user_id='447da297b18f4e7f86fa94cd4d5d7918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a00acfb-905e-4d85-8362-0d613b69a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a00acfb-905e-4d85-8362-0d613b69a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6527f5-a335-4cd6-8335-57df6baaace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6527f5-a335-4cd6-8335-57df6baaace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f78596d7-c339-491a-a0d2-470a1c158a53', 'volume_name': 'volume-f78596d7-c339-491a-a0d2-470a1c158a53', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6c410e-8c34-4965-9da2-bb5fdee085dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6c410e-8c34-4965-9da2-bb5fdee085dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8ed03d-82a7-4cb4-94ba-0da82f30f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:05 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Volume f78596d7-c339-491a-a0d2-470a1c158a53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f78596d7-c339-491a-a0d2-470a1c158a53', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Cloning f78596d7-c339-491a-a0d2-470a1c158a53 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] atach volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02 to target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 42, 5, 130491)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 42, 5, 144466)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] create snapshot v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Acquiring lock "cinder-2a80dad8-f119-40fd-b7e0-d1e9f710aaa7-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Lock "cinder-2a80dad8-f119-40fd-b7e0-d1e9f710aaa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] deleating snapshot s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] get snapshots for volume s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_f78596d7-c339-491a-a0d2-470a1c158a53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] create volume v_f78596d7-c339-491a-a0d2-470a1c158a53 from snapshot v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6339623132356237', 'lun': 0, 'mode': 'wt', 'name': 'v_da07fe19-d0bc-4451-a0c5-29df607f9b02', 'prod_id': 'Storage', 'scsi_id': 'c9b125b74856a34f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] add credentails to target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 201, 'error': None, 'data': {'name': 'AymIXcgr'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] initialize_connection for da07fe19-d0bc-4451-a0c5-29df607f9b02 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AymIXcgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4e65d368-f07f-475c-b7c2-078aa89ad09a'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=66,cinder:INSERT=12,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] get volume s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:06 user cinder-volume[73579]: INFO cinder.volume.manager [req-8079896e-8521-4c24-9771-0343217a9e1e req-e7181130-47ec-4149-b1cb-4484ca1d725d tempest-TaggedBootDevicesTest-135372045 None] attachment_update completed successfully. Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_f78596d7-c339-491a-a0d2-470a1c158a53', 'is_clone': True, 'full_name': 'Pool-0/v_f78596d7-c339-491a-a0d2-470a1c158a53', 'name': 'v_f78596d7-c339-491a-a0d2-470a1c158a53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] get volume v_f78596d7-c339-491a-a0d2-470a1c158a53 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_08decde3-47e7-4399-87e7-0440cdb9d298@s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437931', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110343', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18159148771440761132', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5100cd4ac3521dcb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314514432', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80630', 'name': 's_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] delete snapshot s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 of volume v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_f78596d7-c339-491a-a0d2-470a1c158a53', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f78596d7-c339-491a-a0d2-470a1c158a53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437936', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110355', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12290458028519640957', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a43d3506631a64cd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314514432', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82053', 'name': 'v_f78596d7-c339-491a-a0d2-470a1c158a53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Marking volume f78596d7-c339-491a-a0d2-470a1c158a53 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Creating volume glance metadata for volume f78596d7-c339-491a-a0d2-470a1c158a53 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8ed03d-82a7-4cb4-94ba-0da82f30f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78596d7-c339-491a-a0d2-470a1c158a53', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54488074-1f1d-44e2-840d-b8943a3dd78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:07 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Volume volume-f78596d7-c339-491a-a0d2-470a1c158a53 (f78596d7-c339-491a-a0d2-470a1c158a53): created successfully Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54488074-1f1d-44e2-840d-b8943a3dd78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Flow 'volume_create_manager' (d40744ed-39a0-4877-878f-aa0d5558d249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-18b1a101-9855-4784-a84c-d8edd72a0a9b tempest-TestShelveInstance-437254779 None] Created volume successfully. Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots/s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] snapshot s_2a80dad8-f119-40fd-b7e0-d1e9f710aaa7 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.quota [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Created reservations ['38934488-266a-4576-b3eb-260fc0e79c53', 'd309960a-5540-46ac-aaa4-6a8bea28fa89', '586254f8-41e2-484f-966b-bd58f4d63e29', '4bc13398-e5e3-4dbc-a32e-94379a37cc9b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:42:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Delete snapshot completed successfully. Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-92817be7-883f-4d15-a1d7-82379e70fa13 tempest-VolumesExtendTest-405161943 None] Lock "cinder-2a80dad8-f119-40fd-b7e0-d1e9f710aaa7-delete_snapshot" released by "delete_snapshot" :: held 3.629s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Acquiring lock "cinder-08decde3-47e7-4399-87e7-0440cdb9d298-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Lock "cinder-08decde3-47e7-4399-87e7-0440cdb9d298-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=30,cinder:SELECT=60,cinder:DELETE=3,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] remove_export for volume: 08decde3-47e7-4399-87e7-0440cdb9d298. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-399303551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=08decde3-47e7-4399-87e7-0440cdb9d298,launched_at=2023-04-14T01:42:01Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='c90a5eb6ec8549e2a6d49de1d1c4e6af',provider_auth='CHAP mejLwZVT j9eHkR31Bl0rEL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:00Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:42:10Z,updated_at=2023-04-14T01:42:10Z,use_quota=True,user_id='51413a0a81404e81b92cbf6b70414fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] detach volume v_08decde3-47e7-4399-87e7-0440cdb9d298 from target iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298/luns/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298/luns/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298/luns/v_08decde3-47e7-4399-87e7-0440cdb9d298'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298/luns/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] failed to remove resource iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 because of JDSS resource v_08decde3-47e7-4399-87e7-0440cdb9d298 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] delete target: iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] delete target iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] failed to remove resource iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 because of JDSS resource iqn.2010-10.org.openstack:08decde3-47e7-4399-87e7-0440cdb9d298 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] deleating volume v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] get snapshots for volume v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] create export for volume: f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] ensure volume f78596d7-c339-491a-a0d2-470a1c158a53 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] check if targe iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] get volume v_08decde3-47e7-4399-87e7-0440cdb9d298 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] create target and attach volume f78596d7-c339-491a-a0d2-470a1c158a53 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] create target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_08decde3-47e7-4399-87e7-0440cdb9d298', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437929', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110333', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '400416295475320560', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9026934f584b500b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114314608640', 'san:volume_id': '9026934f584b500b81979e86227c34f5ce90042c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81949', 'name': 'v_08decde3-47e7-4399-87e7-0440cdb9d298', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] delete volume:v_08decde3-47e7-4399-87e7-0440cdb9d298 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] atach volume v_f78596d7-c339-491a-a0d2-470a1c158a53 to target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:42:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_08decde3-47e7-4399-87e7-0440cdb9d298 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] volume v_08decde3-47e7-4399-87e7-0440cdb9d298 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:42:14 user cinder-volume[73579]: DEBUG cinder.quota [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Created reservations ['62f0c50b-1933-4e69-9c42-2532a8286b0c', '02fe52b3-7e80-441b-8c3c-14ded5d3caac', 'b3f78258-97cb-4344-b75d-2f3440bb55a6', '8e64502e-4841-424b-b351-4356b106a1c5'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:42:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:42:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:42:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6134336433353036', 'lun': 0, 'mode': 'wt', 'name': 'v_f78596d7-c339-491a-a0d2-470a1c158a53', 'prod_id': 'Storage', 'scsi_id': 'a43d3506631a64cd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] add credentails to target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:42:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314702848', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.manager [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:42:17 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Deleted volume successfully. Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f0f8261b-2ecb-443b-a604-3770dba34afa tempest-VolumesExtendTest-405161943 None] Lock "cinder-08decde3-47e7-4399-87e7-0440cdb9d298-delete_volume" released by "delete_volume" :: held 7.439s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Geting {'code': 201, 'error': None, 'data': {'name': 'eLIEctAV'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] initialize_connection for f78596d7-c339-491a-a0d2-470a1c158a53 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'b8cabddc-b3b7-413f-a15c-6c0f5a91f190'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Flow 'volume_create_manager' (48330c17-4da7-4986-af19-7fd8904fab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4ab83a-9924-4e88-aad4-1db94e913211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4ab83a-9924-4e88-aad4-1db94e913211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-543453012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6c338230-59bf-4755-bdd9-5e2f28dc339f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4910c626438f42e9a5db828ae4dae86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:42:17Z,use_quota=True,user_id='8ebae9b1685f46aea0064cf83813e4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9c4ab5-60ab-41b3-8568-9e9c23d772a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9c4ab5-60ab-41b3-8568-9e9c23d772a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c9825d-c0f0-4995-9329-4f9e3aa14be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c9825d-c0f0-4995-9329-4f9e3aa14be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c338230-59bf-4755-bdd9-5e2f28dc339f', 'volume_name': 'volume-6c338230-59bf-4755-bdd9-5e2f28dc339f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb316b-1023-42df-8501-7cd3a7efe387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb316b-1023-42df-8501-7cd3a7efe387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063d4fee-b349-48aa-b40c-b129c23970c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:17 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Volume 6c338230-59bf-4755-bdd9-5e2f28dc339f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c338230-59bf-4755-bdd9-5e2f28dc339f', 'volume_size': 1} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] creating volume v_6c338230-59bf-4755-bdd9-5e2f28dc339f. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] create volume {'name': 'v_6c338230-59bf-4755-bdd9-5e2f28dc339f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:17 user cinder-volume[73579]: INFO cinder.volume.manager [req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 req-3584e5b9-a795-4cad-9d76-0591859a3754 tempest-TestShelveInstance-437254779 None] attachment_update completed successfully. Apr 14 01:42:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6c338230-59bf-4755-bdd9-5e2f28dc339f', 'is_clone': False, 'name': 'v_6c338230-59bf-4755-bdd9-5e2f28dc339f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063d4fee-b349-48aa-b40c-b129c23970c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c338230-59bf-4755-bdd9-5e2f28dc339f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6eefc5-d69b-4f60-a07a-3644fc2a726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:18 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Volume volume-6c338230-59bf-4755-bdd9-5e2f28dc339f (6c338230-59bf-4755-bdd9-5e2f28dc339f): created successfully Apr 14 01:42:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6eefc5-d69b-4f60-a07a-3644fc2a726e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Flow 'volume_create_manager' (48330c17-4da7-4986-af19-7fd8904fab06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:18 user cinder-volume[73579]: INFO cinder.volume.manager [None req-70945a75-5ff6-4fdd-b94a-2a7385a80634 tempest-VolumesNegativeTest-116646311 None] Created volume successfully. Apr 14 01:42:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:42:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:42:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:42:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114314608640', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:42:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:42:35 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=50,cinder:UPDATE=20,cinder:INSERT=11 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Flow 'volume_create_manager' (7f424b8e-5917-4450-a685-fa37ab2867df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d2b0a8-2938-43d9-bded-ab1d779b3fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d2b0a8-2938-43d9-bded-ab1d779b3fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1117503168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=91568232-871f-4584-be95-10c420297fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fbd5c190254145815a39079b57881c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:42:37Z,use_quota=True,user_id='2fae797718f548fba18e7bc01829f489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb86a14-6a86-427a-8ced-ca94c4676b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb86a14-6a86-427a-8ced-ca94c4676b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a40c38-4b2e-4384-aa87-ffa22e70484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a40c38-4b2e-4384-aa87-ffa22e70484e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91568232-871f-4584-be95-10c420297fe0', 'volume_name': 'volume-91568232-871f-4584-be95-10c420297fe0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9ba4a7-e211-4970-af01-1715a1411c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9ba4a7-e211-4970-af01-1715a1411c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75913f8f-059a-45ee-a957-78966c5b5a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:36 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Volume 91568232-871f-4584-be95-10c420297fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91568232-871f-4584-be95-10c420297fe0', 'volume_size': 1} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] creating volume v_91568232-871f-4584-be95-10c420297fe0. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] create volume {'name': 'v_91568232-871f-4584-be95-10c420297fe0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_91568232-871f-4584-be95-10c420297fe0', 'is_clone': False, 'name': 'v_91568232-871f-4584-be95-10c420297fe0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75913f8f-059a-45ee-a957-78966c5b5a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91568232-871f-4584-be95-10c420297fe0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e621191f-2390-4fe7-b72a-a307c8a2d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:38 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Volume volume-91568232-871f-4584-be95-10c420297fe0 (91568232-871f-4584-be95-10c420297fe0): created successfully Apr 14 01:42:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e621191f-2390-4fe7-b72a-a307c8a2d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Flow 'volume_create_manager' (7f424b8e-5917-4450-a685-fa37ab2867df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:38 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2749322a-d54e-44d4-a400-3a3e41893738 tempest-DeleteServersTestJSON-1374716489 None] Created volume successfully. Apr 14 01:42:40 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=37,cinder:INSERT=2,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] create export for volume: 91568232-871f-4584-be95-10c420297fe0. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] ensure volume 91568232-871f-4584-be95-10c420297fe0 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] check if targe iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] create target and attach volume 91568232-871f-4584-be95-10c420297fe0 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] create target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] atach volume v_91568232-871f-4584-be95-10c420297fe0 to target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:42:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6131636538306666', 'lun': 0, 'mode': 'wt', 'name': 'v_91568232-871f-4584-be95-10c420297fe0', 'prod_id': 'Storage', 'scsi_id': 'a1ce80ffa5a66fc7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] add credentails to target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:42:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 201, 'error': None, 'data': {'name': 'QXIsxKJu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] initialize_connection for 91568232-871f-4584-be95-10c420297fe0 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:42:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXIsxKJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'c57408e2-41e5-44de-bfed-3b05c5d447ef'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:42:44 user cinder-volume[73579]: INFO cinder.volume.manager [req-63cefeba-b52d-455b-b02e-d47665c00e52 req-1eb8c6c3-c2a6-4d04-8b90-a85aee7d0b26 tempest-DeleteServersTestJSON-1374716489 None] attachment_update completed successfully. Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] terminate connection for 91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:42:49 user cinder-volume[73579]: INFO cinder.volume.manager [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Terminate volume connection completed successfully. Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Deleting attachment c57408e2-41e5-44de-bfed-3b05c5d447ef. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] remove_export for volume: 91568232-871f-4584-be95-10c420297fe0. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1117503168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=91568232-871f-4584-be95-10c420297fe0,launched_at=2023-04-14T01:42:38Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='50fbd5c190254145815a39079b57881c',provider_auth='CHAP QXIsxKJu kQzdsCxFu5H0XE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:37Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:42:47Z,use_quota=True,user_id='2fae797718f548fba18e7bc01829f489',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] detach volume v_91568232-871f-4584-be95-10c420297fe0 from target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] delete target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] delete target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-23a6e185-509a-4dcc-98b3-ef485ed1a00c req-b9145a29-7858-4026-bf83-5cd87a501236 tempest-DeleteServersTestJSON-1374716489 None] target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Flow 'volume_create_manager' (7b974713-5a8d-4013-8d71-a52ff99247f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f4c38b-785c-49e8-8e2c-aa9fff99abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f4c38b-785c-49e8-8e2c-aa9fff99abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-787066069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e51f02c1-71b8-4c63-9bae-d2210e2363dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a409270d6d4d408de33c5e71a56da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:42:55Z,use_quota=True,user_id='bbaf843e44ff4359a15ab6d625134b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f7df1e-c37a-4066-b021-d0c9b28dbbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f7df1e-c37a-4066-b021-d0c9b28dbbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63506532-3536-40bb-90a2-98aaedec5675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63506532-3536-40bb-90a2-98aaedec5675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'volume_name': 'volume-e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1349d746-920e-4fc1-83cd-7eea9273bbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1349d746-920e-4fc1-83cd-7eea9273bbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0659fb7-af74-4cc1-bb29-e8dd058c7370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:55 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Volume e51f02c1-71b8-4c63-9bae-d2210e2363dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'volume_size': 1} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] creating volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] create volume {'name': 'v_e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'is_clone': False, 'name': 'v_e51f02c1-71b8-4c63-9bae-d2210e2363dc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0659fb7-af74-4cc1-bb29-e8dd058c7370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceed4a7-dde4-4260-a5b1-fdfb69103cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:56 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Volume volume-e51f02c1-71b8-4c63-9bae-d2210e2363dc (e51f02c1-71b8-4c63-9bae-d2210e2363dc): created successfully Apr 14 01:42:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceed4a7-dde4-4260-a5b1-fdfb69103cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Flow 'volume_create_manager' (7b974713-5a8d-4013-8d71-a52ff99247f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:56 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0eb3bbac-f540-4829-8a91-829ad7462646 tempest-VolumesAdminNegativeTest-1981219566 None] Created volume successfully. Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] create export for volume: e51f02c1-71b8-4c63-9bae-d2210e2363dc. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] ensure volume e51f02c1-71b8-4c63-9bae-d2210e2363dc assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] check if targe iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] create target and attach volume e51f02c1-71b8-4c63-9bae-d2210e2363dc to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] create target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Flow 'volume_create_manager' (3617bbf8-f45d-44a5-8b1f-c855bde3d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae0cb12-9da3-42f5-b7ba-72845d9c29da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae0cb12-9da3-42f5-b7ba-72845d9c29da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-747040660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9b374309-f641-4369-af29-2e732c69b1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d9a3bf2a3b4480a990adc9821005f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:42:59Z,use_quota=True,user_id='1a1f606719a5435dbcb6092e0708b2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9399771-904a-416d-a664-00e8aab63d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9399771-904a-416d-a664-00e8aab63d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44303922-69cd-4904-9f2f-35bbbb8c968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44303922-69cd-4904-9f2f-35bbbb8c968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b374309-f641-4369-af29-2e732c69b1e9', 'volume_name': 'volume-9b374309-f641-4369-af29-2e732c69b1e9', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a801aead-db24-4227-a77f-3f9886e144ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a801aead-db24-4227-a77f-3f9886e144ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d187364-26b7-4d72-ba79-1d6aca81f237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:42:59 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Volume 9b374309-f641-4369-af29-2e732c69b1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b374309-f641-4369-af29-2e732c69b1e9', 'volume_size': 1} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] creating volume v_9b374309-f641-4369-af29-2e732c69b1e9. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] create volume {'name': 'v_9b374309-f641-4369-af29-2e732c69b1e9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] atach volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc to target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:42:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9b374309-f641-4369-af29-2e732c69b1e9', 'is_clone': False, 'name': 'v_9b374309-f641-4369-af29-2e732c69b1e9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d187364-26b7-4d72-ba79-1d6aca81f237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b374309-f641-4369-af29-2e732c69b1e9', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216ce47d-2684-410e-b28b-8a77b1ee97aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:43:00 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Volume volume-9b374309-f641-4369-af29-2e732c69b1e9 (9b374309-f641-4369-af29-2e732c69b1e9): created successfully Apr 14 01:43:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216ce47d-2684-410e-b28b-8a77b1ee97aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Flow 'volume_create_manager' (3617bbf8-f45d-44a5-8b1f-c855bde3d841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:43:00 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b21c7639-93a7-4fc8-a472-c045bfcd271e tempest-AttachSCSIVolumeTestJSON-716976075 None] Created volume successfully. Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] create export for volume: 9b374309-f641-4369-af29-2e732c69b1e9. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] ensure volume 9b374309-f641-4369-af29-2e732c69b1e9 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] check if targe iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] create target and attach volume 9b374309-f641-4369-af29-2e732c69b1e9 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] create target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6563613437386666', 'lun': 0, 'mode': 'wt', 'name': 'v_e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'prod_id': 'Storage', 'scsi_id': 'eca478ffba74f6cb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] add credentails to target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 201, 'error': None, 'data': {'name': 'THiIXmcP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] initialize_connection for e51f02c1-71b8-4c63-9bae-d2210e2363dc 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:43:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THiIXmcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '6ff41919-53cf-46b4-b3cb-f8e36cb38f7a'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:43:01 user cinder-volume[73579]: INFO cinder.volume.manager [req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 req-ce18238a-79c0-4e42-887b-f07174a4f9f1 tempest-VolumesAdminNegativeTest-1981219566 None] attachment_update completed successfully. Apr 14 01:43:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] atach volume v_9b374309-f641-4369-af29-2e732c69b1e9 to target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:43:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6336373762326361', 'lun': 0, 'mode': 'wt', 'name': 'v_9b374309-f641-4369-af29-2e732c69b1e9', 'prod_id': 'Storage', 'scsi_id': 'c677b2ca1fc4edcb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] add credentails to target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:43:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 201, 'error': None, 'data': {'name': 'NrlyjRDc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] initialize_connection for 9b374309-f641-4369-af29-2e732c69b1e9 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:43:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrlyjRDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '249bd7c9-8144-42a9-8052-77c2c7c345fc'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:43:05 user cinder-volume[73579]: INFO cinder.volume.manager [req-de80350f-ffc8-44ba-98b2-1b899e678d2c req-11ba43d4-c0f6-4fb2-a60f-83394d036315 tempest-AttachSCSIVolumeTestJSON-716976075 None] attachment_update completed successfully. Apr 14 01:43:05 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=56,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] create export for volume: 217c01bb-a21b-4ff9-9e57-99dba019914b. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] ensure volume 217c01bb-a21b-4ff9-9e57-99dba019914b assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] check if targe iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] create target and attach volume 217c01bb-a21b-4ff9-9e57-99dba019914b to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] create target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] terminate connection for e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:07 user cinder-volume[73579]: INFO cinder.volume.manager [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Terminate volume connection completed successfully. Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Deleting attachment 6ff41919-53cf-46b4-b3cb-f8e36cb38f7a. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] remove_export for volume: e51f02c1-71b8-4c63-9bae-d2210e2363dc. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-787066069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e51f02c1-71b8-4c63-9bae-d2210e2363dc,launched_at=2023-04-14T01:42:56Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='d0a409270d6d4d408de33c5e71a56da9',provider_auth='CHAP THiIXmcP RPpnwm24zZIa9S',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:55Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:43:05Z,use_quota=True,user_id='bbaf843e44ff4359a15ab6d625134b07',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] detach volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc from target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] delete target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] delete target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-147be135-9f14-4e93-a84d-8f39b5108b4d req-4d86f185-7e24-4156-8f55-11415e513404 tempest-VolumesAdminNegativeTest-1981219566 None] target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] create export for volume: 7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] ensure volume 7113332c-fb29-4657-be57-be86d245b411 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] check if targe iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] create target and attach volume 7113332c-fb29-4657-be57-be86d245b411 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] create target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] terminate connection for 9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:09 user cinder-volume[73579]: INFO cinder.volume.manager [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Terminate volume connection completed successfully. Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Deleting attachment 249bd7c9-8144-42a9-8052-77c2c7c345fc. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] remove_export for volume: 9b374309-f641-4369-af29-2e732c69b1e9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-747040660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9b374309-f641-4369-af29-2e732c69b1e9,launched_at=2023-04-14T01:43:00Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0d9a3bf2a3b4480a990adc9821005f7f',provider_auth='CHAP NrlyjRDc y9qaxvMIDAuTor',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:59Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:43:09Z,use_quota=True,user_id='1a1f606719a5435dbcb6092e0708b2cb',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] detach volume v_9b374309-f641-4369-af29-2e732c69b1e9 from target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] atach volume v_217c01bb-a21b-4ff9-9e57-99dba019914b to target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] delete target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] delete target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3063383063363434', 'lun': 0, 'mode': 'wt', 'name': 'v_217c01bb-a21b-4ff9-9e57-99dba019914b', 'prod_id': 'Storage', 'scsi_id': '0c80c644cc7a541f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] add credentails to target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:43:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 req-79f8ae62-7fe5-4a19-bec2-aaa9972f26dc tempest-AttachSCSIVolumeTestJSON-716976075 None] target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] atach volume v_7113332c-fb29-4657-be57-be86d245b411 to target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YbsqhwAf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=55,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] initialize_connection for 217c01bb-a21b-4ff9-9e57-99dba019914b 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:43:12 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbsqhwAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '176c9c33-d97c-416c-8fe7-2ff01b1b5d80'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:43:12 user cinder-volume[73579]: INFO cinder.volume.manager [req-9ef211e4-d203-48f6-9b58-28859ad244eb req-0d872c03-cc52-46da-824c-1765455a1c76 tempest-TaggedAttachmentsTest-242857735 None] attachment_update completed successfully. Apr 14 01:43:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6132356465313339', 'lun': 0, 'mode': 'wt', 'name': 'v_7113332c-fb29-4657-be57-be86d245b411', 'prod_id': 'Storage', 'scsi_id': 'a25de1395f535ba4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] add credentails to target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:43:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TAEDvFux'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] initialize_connection for 7113332c-fb29-4657-be57-be86d245b411 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:43:13 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '05f13a2d-ad9d-41cb-8bd8-382568ae9c2b'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:43:13 user cinder-volume[73579]: INFO cinder.volume.manager [req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 req-58dc4111-f1fe-4182-a371-a6bfa05c42e2 tempest-TestVolumeSwap-755712300 None] attachment_update completed successfully. Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] terminate connection for 217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:15 user cinder-volume[73579]: INFO cinder.volume.manager [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Terminate volume connection completed successfully. Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Deleting attachment 176c9c33-d97c-416c-8fe7-2ff01b1b5d80. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] remove_export for volume: 217c01bb-a21b-4ff9-9e57-99dba019914b. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1011104471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=217c01bb-a21b-4ff9-9e57-99dba019914b,launched_at=2023-04-14T01:41:05Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='58f0122cc9864fcea660891e2826ca7b',provider_auth='CHAP YbsqhwAf qOjNixEkMPCW7Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:03Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:43:15Z,use_quota=True,user_id='2bada5cdb7704f6b956eb48b3729388d',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] detach volume v_217c01bb-a21b-4ff9-9e57-99dba019914b from target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] delete target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] delete target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae req-e96a6fd7-9a67-4428-aac3-1376c914119c tempest-TaggedAttachmentsTest-242857735 None] target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] create export for volume: ddd73274-308f-4d71-9930-9ed144269534. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] ensure volume ddd73274-308f-4d71-9930-9ed144269534 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] check if targe iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] create target and attach volume ddd73274-308f-4d71-9930-9ed144269534 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] create target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] atach volume v_ddd73274-308f-4d71-9930-9ed144269534 to target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:43:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6330643436633761', 'lun': 0, 'mode': 'wt', 'name': 'v_ddd73274-308f-4d71-9930-9ed144269534', 'prod_id': 'Storage', 'scsi_id': 'c0d46c7a31b1fba9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] add credentails to target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:43:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Geting {'code': 201, 'error': None, 'data': {'name': 'awmUAnKe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] initialize_connection for ddd73274-308f-4d71-9930-9ed144269534 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:43:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmUAnKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '876b8959-64bb-4bfd-b0f7-6e49869bdb1f'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:43:21 user cinder-volume[73579]: INFO cinder.volume.manager [req-897a6baf-d538-4542-910c-f6e7842df9da req-1082f982-81af-41a5-b22a-0cf0cc9ec25a tempest-TestVolumeSwap-535670122 None] attachment_update completed successfully. Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] terminate connection for 7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:27 user cinder-volume[73579]: INFO cinder.volume.manager [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Terminate volume connection completed successfully. Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Deleting attachment 05f13a2d-ad9d-41cb-8bd8-382568ae9c2b. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] remove_export for volume: 7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1868813248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7113332c-fb29-4657-be57-be86d245b411,launched_at=2023-04-14T01:41:07Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3e707623638044e983b557119edd7673',provider_auth='CHAP TAEDvFux TUuYy1ZXriQIMv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:01Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:43:17Z,use_quota=True,user_id='f6e19e75aa9d4cda971c8d2449e85290',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] detach volume v_7113332c-fb29-4657-be57-be86d245b411 from target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] delete target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] delete target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-897a6baf-d538-4542-910c-f6e7842df9da req-fee2bb90-c491-4b66-87f7-cde3a2cc8a47 tempest-TestVolumeSwap-535670122 None] target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] create export for volume: 7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] ensure volume 7113332c-fb29-4657-be57-be86d245b411 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] check if targe iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] create target and attach volume 7113332c-fb29-4657-be57-be86d245b411 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] create target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:43:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:43:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:43:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114294054912', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:43:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:43:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] atach volume v_7113332c-fb29-4657-be57-be86d245b411 to target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:43:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6132356465313339', 'lun': 0, 'mode': 'wt', 'name': 'v_7113332c-fb29-4657-be57-be86d245b411', 'prod_id': 'Storage', 'scsi_id': 'a25de1395f535ba4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] add credentails to target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:43:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TAEDvFux'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] initialize_connection for 7113332c-fb29-4657-be57-be86d245b411 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:43:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '546bb471-53c3-4ad5-a260-b71738a71680'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:43:34 user cinder-volume[73579]: INFO cinder.volume.manager [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-adb182e1-f9c1-47a7-bb6d-5af6afc2f454 tempest-TestVolumeSwap-535670122 None] attachment_update completed successfully. Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Acquiring lock "cinder-91568232-871f-4584-be95-10c420297fe0-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Lock "cinder-91568232-871f-4584-be95-10c420297fe0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=61,cinder:UPDATE=8 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] remove_export for volume: 91568232-871f-4584-be95-10c420297fe0. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1117503168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=91568232-871f-4584-be95-10c420297fe0,launched_at=2023-04-14T01:42:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fbd5c190254145815a39079b57881c',provider_auth='CHAP QXIsxKJu kQzdsCxFu5H0XE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:37Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:43:38Z,updated_at=2023-04-14T01:43:38Z,use_quota=True,user_id='2fae797718f548fba18e7bc01829f489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] detach volume v_91568232-871f-4584-be95-10c420297fe0 from target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns/v_91568232-871f-4584-be95-10c420297fe0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0/luns/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] failed to remove resource iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 because of JDSS resource v_91568232-871f-4584-be95-10c420297fe0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] delete target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] delete target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] failed to remove resource iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 because of JDSS resource iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] deleating volume v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] get snapshots for volume v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] get volume v_91568232-871f-4584-be95-10c420297fe0 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_91568232-871f-4584-be95-10c420297fe0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437967', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110377', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5556648073507395245', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a1ce80ffa5a66fc7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294030336', 'san:volume_id': 'a1ce80ffa5a66fc7ab175a3342d7554ac3fc0ad4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81759', 'name': 'v_91568232-871f-4584-be95-10c420297fe0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] delete volume:v_91568232-871f-4584-be95-10c420297fe0 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] terminate connection for ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:40 user cinder-volume[73579]: INFO cinder.volume.manager [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Terminate volume connection completed successfully. Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Deleting attachment 876b8959-64bb-4bfd-b0f7-6e49869bdb1f. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] remove_export for volume: ddd73274-308f-4d71-9930-9ed144269534. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1182241430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ddd73274-308f-4d71-9930-9ed144269534,launched_at=2023-04-14T01:41:11Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3e707623638044e983b557119edd7673',provider_auth='CHAP awmUAnKe zqpX82yDBvOtjH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:08Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:43:29Z,use_quota=True,user_id='f6e19e75aa9d4cda971c8d2449e85290',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] detach volume v_ddd73274-308f-4d71-9930-9ed144269534 from target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] delete target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] delete target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 req-61a216dd-d9ae-4c3e-b93c-b555b9dd5e2e tempest-TestVolumeSwap-535670122 None] target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91568232-871f-4584-be95-10c420297fe0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] volume v_91568232-871f-4584-be95-10c420297fe0 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.quota [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Created reservations ['0c48615b-6655-46f6-9a9d-5201ee1cf44e', 'd57871ac-305c-498a-835b-462b1bc2c534', 'f084a3aa-5c71-4487-904d-561c5709db27', 'b442b141-b49c-475e-ab04-11acd8900fd5'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294112256', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:43:41 user cinder-volume[73579]: DEBUG cinder.manager [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:43:41 user cinder-volume[73579]: INFO cinder.volume.manager [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Deleted volume successfully. Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-50577521-7f9c-49eb-a67c-c0e36705fae8 tempest-DeleteServersTestJSON-1374716489 None] Lock "cinder-91568232-871f-4584-be95-10c420297fe0-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d5e9cd17-d0c9-4123-b0c0-66d91ae5f86c tempest-VolumesActionsTest-193871514 None] Acquiring lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" by "attach_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d5e9cd17-d0c9-4123-b0c0-66d91ae5f86c tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" acquired by "attach_volume" :: waited 0.019s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=59,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d5e9cd17-d0c9-4123-b0c0-66d91ae5f86c tempest-VolumesActionsTest-193871514 None] Attaching volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f to instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb at mountpoint /dev/vdb on host None. Apr 14 01:43:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d5e9cd17-d0c9-4123-b0c0-66d91ae5f86c tempest-VolumesActionsTest-193871514 None] Attach volume completed successfully. Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d5e9cd17-d0c9-4123-b0c0-66d91ae5f86c tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" released by "attach_volume" :: held 0.083s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Acquiring lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-detach_volume" by "detach_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.coordination [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:43:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Detaching volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f from instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb. Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] remove_export for volume: 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030025018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f,launched_at=2023-04-14T01:41:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb176ac656c47b38e736fc629fc46e0',provider_auth='CHAP NHSYgVvB zt0HpaTsvmVBJD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:48Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:43:42Z,use_quota=True,user_id='8b18b911fcf847efbf4f814f3b687279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] detach volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f from target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] failed to remove resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f because of JDSS resource v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] delete target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] delete target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] failed to remove resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f because of JDSS resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:43:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Detach volume completed successfully. Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-17fbc54d-6f2c-437d-bc9d-b644754b5524 tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] terminate connection for 7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:43 user cinder-volume[73579]: INFO cinder.volume.manager [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Terminate volume connection completed successfully. Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Deleting attachment 546bb471-53c3-4ad5-a260-b71738a71680. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] remove_export for volume: 7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1868813248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7113332c-fb29-4657-be57-be86d245b411,launched_at=2023-04-14T01:41:07Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3e707623638044e983b557119edd7673',provider_auth='CHAP TAEDvFux TUuYy1ZXriQIMv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:01Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:43:42Z,use_quota=True,user_id='f6e19e75aa9d4cda971c8d2449e85290',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] detach volume v_7113332c-fb29-4657-be57-be86d245b411 from target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] delete target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] delete target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d req-d6ff412c-e9a8-4e4d-b441-59b009038615 tempest-TestVolumeSwap-755712300 None] target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Flow 'volume_create_manager' (bb714fe9-f1e5-4129-8a55-b8c5a35c93ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18630681-d765-4482-840c-677a789adcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18630681-d765-4482-840c-677a789adcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:43:45Z,deleted=False,deleted_at=None,display_description='',display_name='73fd9bc1-af0f-41e9-adea-d73323b4a76c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0856ebd5-320b-4f5a-b305-4b1a0be6fb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c39c8299e46368012a947fdfbe5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:43:45Z,use_quota=True,user_id='7ed01a83531f4c6bb18a4593284baf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd66d3e9-0b62-4fbc-a9d1-e35d1bd3e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd66d3e9-0b62-4fbc-a9d1-e35d1bd3e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312780fc-a795-4840-b143-81d7ec66a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312780fc-a795-4840-b143-81d7ec66a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'volume_name': 'volume-0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e03e7-a117-4ee4-9ccf-99a68eed4afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e03e7-a117-4ee4-9ccf-99a68eed4afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0599ab49-bd43-4808-9086-306de2feb004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:43:45 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Volume 0856ebd5-320b-4f5a-b305-4b1a0be6fb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'volume_size': 1} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] creating volume v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create volume {'name': 'v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'is_clone': False, 'name': 'v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0599ab49-bd43-4808-9086-306de2feb004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddf4f96-b9b4-4989-b331-f758d51931bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:43:46 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Volume volume-0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (0856ebd5-320b-4f5a-b305-4b1a0be6fb22): created successfully Apr 14 01:43:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddf4f96-b9b4-4989-b331-f758d51931bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:43:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Flow 'volume_create_manager' (bb714fe9-f1e5-4129-8a55-b8c5a35c93ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:43:46 user cinder-volume[73579]: INFO cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-4a2cc64f-9e29-4228-836a-74a5a308c0f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Created volume successfully. Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] terminate connection for 5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:47 user cinder-volume[73579]: INFO cinder.volume.manager [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Terminate volume connection completed successfully. Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Deleting attachment a2d4b20a-282f-4cf8-b9cb-1bb84bcb8db0. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] remove_export for volume: 5e9b1e2c-15a4-481a-a713-fa24dca0918e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2085378583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e9b1e2c-15a4-481a-a713-fa24dca0918e,launched_at=2023-04-14T01:41:27Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth='CHAP oLYPhWbV XUk1DIEgQ5ZqrF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:02Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:41:56Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] detach volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e from target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] delete target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] delete target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-ddaf687e-d62f-4895-913b-2623adf64a73 tempest-TaggedBootDevicesTest-135372045 None] target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] terminate connection for 953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:48 user cinder-volume[73579]: INFO cinder.volume.manager [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Terminate volume connection completed successfully. Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Deleting attachment 382fb1d8-0966-4964-95a3-acafbfaf1d06. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] remove_export for volume: 953520b1-6ecb-41ad-8793-851901048f6d. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-137866865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=953520b1-6ecb-41ad-8793-851901048f6d,launched_at=2023-04-14T01:41:30Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth='CHAP TXlNnZyv oFqc96D5UzXi4G',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:28Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:42:02Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] detach volume v_953520b1-6ecb-41ad-8793-851901048f6d from target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] delete target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] delete target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-8016bb7a-92a6-4851-9ad9-fef797783569 tempest-TaggedBootDevicesTest-135372045 None] target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] terminate connection for da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:43:49 user cinder-volume[73579]: INFO cinder.volume.manager [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Terminate volume connection completed successfully. Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Deleting attachment 4e65d368-f07f-475c-b7c2-078aa89ad09a. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] remove_export for volume: da07fe19-d0bc-4451-a0c5-29df607f9b02. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1551315636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=da07fe19-d0bc-4451-a0c5-29df607f9b02,launched_at=2023-04-14T01:41:32Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth='CHAP AymIXcgr 8uMAcsZjv26K4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:31Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:42:07Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] detach volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02 from target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] delete target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] delete target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a6b69e38-42f0-4b0d-9f0f-7bbcd50d1120 tempest-GroupsV320Test-1177210334 None] Group tempest-GroupsV320Test-Group-1452629499: creating Apr 14 01:43:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a6b69e38-42f0-4b0d-9f0f-7bbcd50d1120 tempest-GroupsV320Test-1177210334 None] Group tempest-GroupsV320Test-Group-1452629499: created successfully Apr 14 01:43:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a6b69e38-42f0-4b0d-9f0f-7bbcd50d1120 tempest-GroupsV320Test-1177210334 None] Create group completed successfully. Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 req-1569805b-9f06-49ce-928d-c567eaa1408f tempest-TaggedBootDevicesTest-135372045 None] target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create export for volume: 0856ebd5-320b-4f5a-b305-4b1a0be6fb22. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] ensure volume 0856ebd5-320b-4f5a-b305-4b1a0be6fb22 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] check if targe iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create target and attach volume 0856ebd5-320b-4f5a-b305-4b1a0be6fb22 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create target iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:51 user cinder-volume[73579]: DEBUG cinder.quota [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Created reservations ['efe2991e-6a34-460b-9e0a-cd5ae454a320'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:43:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:43:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:43:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294030336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:43:52 user cinder-volume[73579]: DEBUG cinder.manager [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:43:52 user cinder-volume[73579]: INFO cinder.volume.manager [None req-88a3835f-c77d-4138-befc-ed48c2eaf4d8 tempest-GroupsV320Test-1177210334 None] Delete group completed successfully. Apr 14 01:43:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] atach volume v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22 to target iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:43:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3539636265343736', 'lun': 0, 'mode': 'wt', 'name': 'v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'prod_id': 'Storage', 'scsi_id': '59cbe476ba584896'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] add credentails to target iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:43:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:43:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:43:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 201, 'error': None, 'data': {'name': 'hCwSrpEd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:43:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] initialize_connection for 0856ebd5-320b-4f5a-b305-4b1a0be6fb22 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:43:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ae1038cb-9890-4797-aade-3705c75e2976'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:43:54 user cinder-volume[73579]: INFO cinder.volume.manager [req-e74ea766-ad24-4f86-a2d5-f66e163582f6 req-e97f724d-904d-4b4a-8e24-a8087346d335 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] attachment_update completed successfully. Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Flow 'volume_create_manager' (0059c1ad-fc99-4828-b30d-76d614038cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74dd720-9a2f-4d40-a679-dc8d5c823e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74dd720-9a2f-4d40-a679-dc8d5c823e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1936583786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49ff140b-2ff0-402c-b233-5c47e1aeb5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3a0603398d4e58ac6144e35e64c849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:04Z,use_quota=True,user_id='77753ad9c7784cfd91d0e4a90cb2f24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94538e4b-a696-4752-8691-258c717035ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94538e4b-a696-4752-8691-258c717035ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84003bdc-fa6d-4640-9e04-14d2a4350f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84003bdc-fa6d-4640-9e04-14d2a4350f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'volume_name': 'volume-49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07b1cab-6a59-4b16-8558-d62ccda331a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07b1cab-6a59-4b16-8558-d62ccda331a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736dc2d9-365f-4696-ba9b-1a42dcc65514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Volume 49ff140b-2ff0-402c-b233-5c47e1aeb5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'volume_size': 1} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] creating volume v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] create volume {'name': 'v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'is_clone': False, 'name': 'v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736dc2d9-365f-4696-ba9b-1a42dcc65514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e64abf3-83b9-4aaa-95d7-09280af6b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:04 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Volume volume-49ff140b-2ff0-402c-b233-5c47e1aeb5c6 (49ff140b-2ff0-402c-b233-5c47e1aeb5c6): created successfully Apr 14 01:44:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e64abf3-83b9-4aaa-95d7-09280af6b0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Flow 'volume_create_manager' (0059c1ad-fc99-4828-b30d-76d614038cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7d7a25a9-a461-4c56-b03f-1112aba8af58 tempest-VolumesMetadataTest-804550714 None] Created volume successfully. Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Acquiring lock "cinder-9b374309-f641-4369-af29-2e732c69b1e9-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Lock "cinder-9b374309-f641-4369-af29-2e732c69b1e9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=71,cinder:UPDATE=28,cinder:INSERT=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] remove_export for volume: 9b374309-f641-4369-af29-2e732c69b1e9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-747040660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9b374309-f641-4369-af29-2e732c69b1e9,launched_at=2023-04-14T01:43:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d9a3bf2a3b4480a990adc9821005f7f',provider_auth='CHAP NrlyjRDc y9qaxvMIDAuTor',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:59Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:44:05Z,updated_at=2023-04-14T01:44:05Z,use_quota=True,user_id='1a1f606719a5435dbcb6092e0708b2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] detach volume v_9b374309-f641-4369-af29-2e732c69b1e9 from target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns/v_9b374309-f641-4369-af29-2e732c69b1e9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9/luns/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] failed to remove resource iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 because of JDSS resource v_9b374309-f641-4369-af29-2e732c69b1e9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] delete target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] delete target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] failed to remove resource iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 because of JDSS resource iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] deleating volume v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] get snapshots for volume v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] get volume v_9b374309-f641-4369-af29-2e732c69b1e9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9b374309-f641-4369-af29-2e732c69b1e9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437989', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110392', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18384444915934168326', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c677b2ca1fc4edcb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293919744', 'san:volume_id': 'c677b2ca1fc4edcbd7f69dc5694f779d54c57a90', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81140', 'name': 'v_9b374309-f641-4369-af29-2e732c69b1e9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] delete volume:v_9b374309-f641-4369-af29-2e732c69b1e9 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] terminate connection for f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:44:06 user cinder-volume[73579]: INFO cinder.volume.manager [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Terminate volume connection completed successfully. Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Deleting attachment b8cabddc-b3b7-413f-a15c-6c0f5a91f190. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] remove_export for volume: f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1954746558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f78596d7-c339-491a-a0d2-470a1c158a53,launched_at=2023-04-14T01:42:08Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',provider_auth='CHAP eLIEctAV AF2jgh5YQbo6vk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:05Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:42:18Z,use_quota=True,user_id='447da297b18f4e7f86fa94cd4d5d7918',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] detach volume v_f78596d7-c339-491a-a0d2-470a1c158a53 from target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Acquiring lock "cinder-49ff140b-2ff0-402c-b233-5c47e1aeb5c6-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Lock "cinder-49ff140b-2ff0-402c-b233-5c47e1aeb5c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] remove_export for volume: 49ff140b-2ff0-402c-b233-5c47e1aeb5c6. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1936583786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49ff140b-2ff0-402c-b233-5c47e1aeb5c6,launched_at=2023-04-14T01:44:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3a0603398d4e58ac6144e35e64c849',provider_auth='CHAP sObKcHLt cnoU05w8TjPSAv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:44:06Z,updated_at=2023-04-14T01:44:06Z,use_quota=True,user_id='77753ad9c7784cfd91d0e4a90cb2f24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] detach volume v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 from target iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6/luns/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6/luns/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6/luns/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6/luns/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] failed to remove resource iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 because of JDSS resource v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] delete target: iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] delete target iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] failed to remove resource iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 because of JDSS resource iqn.2010-10.org.openstack:49ff140b-2ff0-402c-b233-5c47e1aeb5c6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] deleating volume v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] get snapshots for volume v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] delete target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] delete target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] get volume v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 req-1dd359fa-2a7d-44c5-8d18-694423d04e7f tempest-TestShelveInstance-437254779 None] target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438053', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110458', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5937337857972748520', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'da9dabf8a2bcbe14', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294001664', 'san:volume_id': 'da9dabf8a2bcbe145eb80512795f55a938a82a83', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81900', 'name': 'v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] delete volume:v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9b374309-f641-4369-af29-2e732c69b1e9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] volume v_9b374309-f641-4369-af29-2e732c69b1e9 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.quota [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Created reservations ['dcfa0b16-0e95-4c98-8148-c8bd1a069cd0', 'ceec45f2-9d53-495b-9fd3-bbcd4ac29a5b', '0734ff34-8a74-4cd2-a8c1-3621289fee35', 'f5e60991-6f15-42df-ba78-8a28165a5e74'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294001664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:08 user cinder-volume[73579]: DEBUG cinder.manager [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Deleted volume successfully. Apr 14 01:44:08 user cinder-volume[73579]: DEBUG cinder.coordination [None req-43e2baf0-93d7-49b4-a923-87ae82cf913c tempest-AttachSCSIVolumeTestJSON-716976075 None] Lock "cinder-9b374309-f641-4369-af29-2e732c69b1e9-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] volume v_49ff140b-2ff0-402c-b233-5c47e1aeb5c6 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=78,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG cinder.quota [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Created reservations ['4c43a836-2cf8-4624-ac88-a15a726e75f5', 'cf369673-ebe4-4022-afe3-a5aca7b4d1b7', '80fe5716-6987-4623-ba40-33951ed63d74', '061beed5-1d6e-4d6c-b019-33ef7ba460bf'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294083584', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:10 user cinder-volume[73579]: DEBUG cinder.manager [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:10 user cinder-volume[73579]: INFO cinder.volume.manager [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Deleted volume successfully. Apr 14 01:44:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-51b757cd-7e8a-4b7c-ac5e-39852cd0c979 tempest-VolumesMetadataTest-804550714 None] Lock "cinder-49ff140b-2ff0-402c-b233-5c47e1aeb5c6-delete_volume" released by "delete_volume" :: held 3.926s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:44:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c9c28317-008f-448f-87c9-be7dc7d00b8d tempest-GroupsTest-2025235028 None] Group tempest-Group1-110663792: creating Apr 14 01:44:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c9c28317-008f-448f-87c9-be7dc7d00b8d tempest-GroupsTest-2025235028 None] Group tempest-Group1-110663792: created successfully Apr 14 01:44:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c9c28317-008f-448f-87c9-be7dc7d00b8d tempest-GroupsTest-2025235028 None] Create group completed successfully. Apr 14 01:44:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cf29b6ed-2082-453d-86e3-26cc05bb44dd tempest-GroupsTest-2025235028 None] Group tempest-Group2-321605783: creating Apr 14 01:44:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cf29b6ed-2082-453d-86e3-26cc05bb44dd tempest-GroupsTest-2025235028 None] Group tempest-Group2-321605783: created successfully Apr 14 01:44:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cf29b6ed-2082-453d-86e3-26cc05bb44dd tempest-GroupsTest-2025235028 None] Create group completed successfully. Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Flow 'volume_create_manager' (9af915ac-6983-4d97-944e-6c304b9c1eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6940f252-c012-4691-a0e6-ee1b81a1c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6940f252-c012-4691-a0e6-ee1b81a1c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-281944514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6c65294-39b4-460b-97dc-24f26a67f97f,host='user@joviandss-2#joviandss-2',id=88ca0ed2-dd68-4899-a1b7-c09732edab01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bc4ea12df147e9b7662ec354ae7cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:23Z,use_quota=True,user_id='ac5bc15e8b994c159dd9a011a26ef648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3681b636-e93a-474b-badd-c449e3ea6429),volume_type_id=3681b636-e93a-474b-badd-c449e3ea6429)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b008c5a-abba-4335-a5eb-757234967c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b008c5a-abba-4335-a5eb-757234967c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de43aef2-7623-45e5-a3cd-a1832b0d742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de43aef2-7623-45e5-a3cd-a1832b0d742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ca0ed2-dd68-4899-a1b7-c09732edab01', 'volume_name': 'volume-88ca0ed2-dd68-4899-a1b7-c09732edab01', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2437e1d-2a67-4464-afa6-07a987760004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2437e1d-2a67-4464-afa6-07a987760004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976fa290-8884-4852-b7d4-7edf584478e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:22 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Volume 88ca0ed2-dd68-4899-a1b7-c09732edab01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ca0ed2-dd68-4899-a1b7-c09732edab01', 'volume_size': 1} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] creating volume v_88ca0ed2-dd68-4899-a1b7-c09732edab01. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] create volume {'name': 'v_88ca0ed2-dd68-4899-a1b7-c09732edab01', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_88ca0ed2-dd68-4899-a1b7-c09732edab01', 'is_clone': False, 'name': 'v_88ca0ed2-dd68-4899-a1b7-c09732edab01'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976fa290-8884-4852-b7d4-7edf584478e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ca0ed2-dd68-4899-a1b7-c09732edab01', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af04bf7a-a65f-4fce-a57a-688b3fbdb809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Volume volume-88ca0ed2-dd68-4899-a1b7-c09732edab01 (88ca0ed2-dd68-4899-a1b7-c09732edab01): created successfully Apr 14 01:44:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af04bf7a-a65f-4fce-a57a-688b3fbdb809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Flow 'volume_create_manager' (9af915ac-6983-4d97-944e-6c304b9c1eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:23 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ddfd65b8-d93f-4333-a418-8a3a0583ac35 tempest-GroupsTest-2025235028 None] Created volume successfully. Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] remove_export for volume: 88ca0ed2-dd68-4899-a1b7-c09732edab01. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-281944514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6c65294-39b4-460b-97dc-24f26a67f97f,host='user@joviandss-2#joviandss-2',id=88ca0ed2-dd68-4899-a1b7-c09732edab01,launched_at=2023-04-14T01:44:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bc4ea12df147e9b7662ec354ae7cb3',provider_auth='CHAP iDXanuZv O2enG0ckPvaQtg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:23Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T01:44:24Z,use_quota=True,user_id='ac5bc15e8b994c159dd9a011a26ef648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3681b636-e93a-474b-badd-c449e3ea6429),volume_type_id=3681b636-e93a-474b-badd-c449e3ea6429) from target:iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] detach volume v_88ca0ed2-dd68-4899-a1b7-c09732edab01 from target iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01/luns/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01/luns/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01/luns/v_88ca0ed2-dd68-4899-a1b7-c09732edab01'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01/luns/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] failed to remove resource iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 because of JDSS resource v_88ca0ed2-dd68-4899-a1b7-c09732edab01 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] delete target: iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] delete target iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] failed to remove resource iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 because of JDSS resource iqn.2010-10.org.openstack:88ca0ed2-dd68-4899-a1b7-c09732edab01 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] deleating volume v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] get snapshots for volume v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] get volume v_88ca0ed2-dd68-4899-a1b7-c09732edab01 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_88ca0ed2-dd68-4899-a1b7-c09732edab01', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438072', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110470', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3107704069290865468', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9d75b551cd269cc6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294001664', 'san:volume_id': '9d75b551cd269cc648327a7229e325ab0170c65f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80986', 'name': 'v_88ca0ed2-dd68-4899-a1b7-c09732edab01', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] delete volume:v_88ca0ed2-dd68-4899-a1b7-c09732edab01 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88ca0ed2-dd68-4899-a1b7-c09732edab01 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] volume v_88ca0ed2-dd68-4899-a1b7-c09732edab01 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.quota [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Created reservations ['beb88667-1594-48c7-8aed-f1637f448711'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:26 user cinder-volume[73579]: WARNING cinder.quota [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1759297847 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1759297847, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:44:26 user cinder-volume[73579]: WARNING cinder.quota [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1759297847 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1759297847, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:44:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.quota [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Created reservations ['960000e7-6063-4137-b3f2-d109f06cdb6a', '53e6db7b-7ca0-404e-baab-c7d35062976c', '4f51a879-b9fd-4c18-a0f3-744986909b98', '54325774-50dd-46f6-afe7-4a90fab33188'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:26 user cinder-volume[73579]: DEBUG cinder.quota [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Created reservations ['7e74be1b-f8d8-4444-8dae-4840eaefa61c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294083584', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.manager [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-aa06e4ce-508d-4d72-a9c9-c78df7489685 tempest-GroupsTest-2025235028 None] Delete group completed successfully. Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294071296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.manager [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-dc216b7e-0cd7-4a68-91bc-02adce906325 tempest-GroupsTest-2025235028 None] Delete group completed successfully. Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (9ae9548b-193f-4f80-98e7-d45b640f5a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d111ff97-e237-477c-b511-0181fc85a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d111ff97-e237-477c-b511-0181fc85a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-229139402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9ec4ec10-1905-471c-90ef-6a4fdac9a0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:28Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f156b65a-8d33-4b87-91d0-0354b8026404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f156b65a-8d33-4b87-91d0-0354b8026404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e97ec11-a28e-40fd-b4bf-6082a47b9395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e97ec11-a28e-40fd-b4bf-6082a47b9395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'volume_name': 'volume-9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33aa6466-23ab-449d-a3e1-1a7df5c858e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33aa6466-23ab-449d-a3e1-1a7df5c858e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a68253-4deb-4539-8798-fe5c2ed3e315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:27 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Volume 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Cloning 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 44, 27, 918070)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 44, 27, 934313)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] create snapshot v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9bc90caa-e416-48d1-9b37-66f68922a6f8 tempest-GroupsTest-2025235028 None] Group tempest-GroupsTest-Group-1935856624: creating Apr 14 01:44:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9bc90caa-e416-48d1-9b37-66f68922a6f8 tempest-GroupsTest-2025235028 None] Group tempest-GroupsTest-Group-1935856624: created successfully Apr 14 01:44:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9bc90caa-e416-48d1-9b37-66f68922a6f8 tempest-GroupsTest-2025235028 None] Create group completed successfully. Apr 14 01:44:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] create volume v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 from snapshot v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:44:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'is_clone': True, 'full_name': 'Pool-0/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'name': 'v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] get volume v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438078', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110477', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10440273845844845776', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cca6d43863d7b5d3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294059008', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81001', 'name': 'v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Marking volume 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Creating volume glance metadata for volume 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=28,cinder:SELECT=64,cinder:DELETE=2,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a68253-4deb-4539-8798-fe5c2ed3e315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ae092e-1c5b-41b8-a588-7a72fbf0f084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Volume volume-9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 (9ec4ec10-1905-471c-90ef-6a4fdac9a0e5): created successfully Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ae092e-1c5b-41b8-a588-7a72fbf0f084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (9ae9548b-193f-4f80-98e7-d45b640f5a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:29 user cinder-volume[73579]: INFO cinder.volume.manager [None req-169613a2-75c1-45d0-87d8-8c732bbd7d8b tempest-TestVolumeBootPattern-224521177 None] Created volume successfully. Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Flow 'volume_create_manager' (24685834-36f2-488d-a6a4-5645fa24bc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11c192d-9280-4d15-a91f-1019cbc61ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11c192d-9280-4d15-a91f-1019cbc61ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-999044072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a00e06-ff5e-4f16-bb65-25e520b983dd,host='user@joviandss-2#joviandss-2',id=296c91ea-5012-40ab-8aa9-88c734a03de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bc4ea12df147e9b7662ec354ae7cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:30Z,use_quota=True,user_id='ac5bc15e8b994c159dd9a011a26ef648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efa9f958-d793-4247-b2e2-ec9708dd0f5e),volume_type_id=efa9f958-d793-4247-b2e2-ec9708dd0f5e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed554b7-bb1c-4a63-b26e-b991cda7faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed554b7-bb1c-4a63-b26e-b991cda7faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe91014e-e952-4c8c-8a67-1053f426d40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe91014e-e952-4c8c-8a67-1053f426d40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296c91ea-5012-40ab-8aa9-88c734a03de7', 'volume_name': 'volume-296c91ea-5012-40ab-8aa9-88c734a03de7', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69effc63-0bbc-4512-9bfa-01164ef10407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69effc63-0bbc-4512-9bfa-01164ef10407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a210f40-f924-4b28-838a-323fafbb183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Volume 296c91ea-5012-40ab-8aa9-88c734a03de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296c91ea-5012-40ab-8aa9-88c734a03de7', 'volume_size': 1} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] creating volume v_296c91ea-5012-40ab-8aa9-88c734a03de7. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] create volume {'name': 'v_296c91ea-5012-40ab-8aa9-88c734a03de7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_296c91ea-5012-40ab-8aa9-88c734a03de7', 'is_clone': False, 'name': 'v_296c91ea-5012-40ab-8aa9-88c734a03de7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a210f40-f924-4b28-838a-323fafbb183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296c91ea-5012-40ab-8aa9-88c734a03de7', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28421fcb-73e3-43a2-976c-6126f70d7db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Volume volume-296c91ea-5012-40ab-8aa9-88c734a03de7 (296c91ea-5012-40ab-8aa9-88c734a03de7): created successfully Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28421fcb-73e3-43a2-976c-6126f70d7db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Flow 'volume_create_manager' (24685834-36f2-488d-a6a4-5645fa24bc04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-61e4d7c0-4b5e-4e45-9d28-b319fee22579 tempest-GroupsTest-2025235028 None] Created volume successfully. Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] create snapshot 9407ec8e-7fa7-49e3-81a0-e6659fd98f5d for volume 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] cloning v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 to s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] create snapshot s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293964800', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Flow 'volume_create_manager' (898e4b1d-dc22-4759-ae1e-5a7745f1e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efcb81a-48e8-4171-9db1-5d50d19e24b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efcb81a-48e8-4171-9db1-5d50d19e24b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578141108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a00e06-ff5e-4f16-bb65-25e520b983dd,host='user@joviandss-2#joviandss-2',id=ce111437-8ae3-434b-9449-99264333f13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bc4ea12df147e9b7662ec354ae7cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:31Z,use_quota=True,user_id='ac5bc15e8b994c159dd9a011a26ef648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efa9f958-d793-4247-b2e2-ec9708dd0f5e),volume_type_id=efa9f958-d793-4247-b2e2-ec9708dd0f5e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674958b8-5c42-41ca-84fe-d85fa503abec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674958b8-5c42-41ca-84fe-d85fa503abec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5614491d-8db3-47c7-853c-191758344949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5614491d-8db3-47c7-853c-191758344949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce111437-8ae3-434b-9449-99264333f13f', 'volume_name': 'volume-ce111437-8ae3-434b-9449-99264333f13f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b1fdcd-6903-488e-a7c8-d2b94817d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b1fdcd-6903-488e-a7c8-d2b94817d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1563b42b-7b5f-4a66-a459-05ed673bf560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:31 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Volume ce111437-8ae3-434b-9449-99264333f13f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce111437-8ae3-434b-9449-99264333f13f', 'volume_size': 1} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] creating volume v_ce111437-8ae3-434b-9449-99264333f13f. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] create volume {'name': 'v_ce111437-8ae3-434b-9449-99264333f13f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] create volume s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d from snapshot s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ce111437-8ae3-434b-9449-99264333f13f', 'is_clone': False, 'name': 'v_ce111437-8ae3-434b-9449-99264333f13f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1563b42b-7b5f-4a66-a459-05ed673bf560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce111437-8ae3-434b-9449-99264333f13f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09e5124-803e-4050-bb95-a8fcfb0bc9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:32 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Volume volume-ce111437-8ae3-434b-9449-99264333f13f (ce111437-8ae3-434b-9449-99264333f13f): created successfully Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09e5124-803e-4050-bb95-a8fcfb0bc9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Flow 'volume_create_manager' (898e4b1d-dc22-4759-ae1e-5a7745f1e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:32 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8ab7261d-c925-4344-873f-15518d70c2ff tempest-GroupsTest-2025235028 None] Created volume successfully. Apr 14 01:44:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5@s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d', 'is_clone': True, 'full_name': 'Pool-0/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d', 'name': 's_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] volume s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:44:33 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4a662a60-c985-4829-adb8-c7866d59cd34 tempest-TestVolumeBootPattern-224521177 None] Create snapshot completed successfully Apr 14 01:44:34 user cinder-volume[73579]: INFO cinder.volume.manager [None req-223138dc-d69d-45f7-8985-ff033e7d636e tempest-GroupsTest-2025235028 None] Update group completed successfully. Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Flow 'volume_create_manager' (ec4ed35e-0f89-42c9-8ede-919cffd82a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafe7d66-8688-4167-a95d-9e6460f981e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafe7d66-8688-4167-a95d-9e6460f981e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-94214556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7298e05a-b142-4365-95e1-f8551de0ae79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4833ddea1fa74866b97ef52a730605aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:35Z,use_quota=True,user_id='f09ab986a00f43b384cf5d517857a13d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58505921-77d3-4de8-abbc-aefb36c5b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58505921-77d3-4de8-abbc-aefb36c5b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884caa02-60cd-4867-8c8d-c2e493a0c032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884caa02-60cd-4867-8c8d-c2e493a0c032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7298e05a-b142-4365-95e1-f8551de0ae79', 'volume_name': 'volume-7298e05a-b142-4365-95e1-f8551de0ae79', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9bc4e-c8e2-4d9e-a87f-d5fcaf7eebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9bc4e-c8e2-4d9e-a87f-d5fcaf7eebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f0cf9-b48c-4f09-aa8a-8294eeaf0bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:35 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Volume 7298e05a-b142-4365-95e1-f8551de0ae79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7298e05a-b142-4365-95e1-f8551de0ae79', 'volume_size': 1} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] creating volume v_7298e05a-b142-4365-95e1-f8551de0ae79. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] create volume {'name': 'v_7298e05a-b142-4365-95e1-f8551de0ae79', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:35 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1b16644e-290e-4b7e-b51d-333e40550441 tempest-GroupsTest-2025235028 None] Update group completed successfully. Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7298e05a-b142-4365-95e1-f8551de0ae79', 'is_clone': False, 'name': 'v_7298e05a-b142-4365-95e1-f8551de0ae79'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Acquiring lock "cinder-da07fe19-d0bc-4451-a0c5-29df607f9b02-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f0cf9-b48c-4f09-aa8a-8294eeaf0bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7298e05a-b142-4365-95e1-f8551de0ae79', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e40ec9-0970-4f6b-97d3-9c9a1204f8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:36 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Volume volume-7298e05a-b142-4365-95e1-f8551de0ae79 (7298e05a-b142-4365-95e1-f8551de0ae79): created successfully Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e40ec9-0970-4f6b-97d3-9c9a1204f8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Flow 'volume_create_manager' (ec4ed35e-0f89-42c9-8ede-919cffd82a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-da07fe19-d0bc-4451-a0c5-29df607f9b02-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:36 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6ade0b10-4874-479d-9724-84b961ac3a1d tempest-ServerStableDeviceRescueTest-131403183 None] Created volume successfully. Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] remove_export for volume: da07fe19-d0bc-4451-a0c5-29df607f9b02. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1551315636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=da07fe19-d0bc-4451-a0c5-29df607f9b02,launched_at=2023-04-14T01:41:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth='CHAP AymIXcgr 8uMAcsZjv26K4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:31Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:44:36Z,updated_at=2023-04-14T01:44:36Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] detach volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02 from target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns/v_da07fe19-d0bc-4451-a0c5-29df607f9b02'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02/luns/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] failed to remove resource iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 because of JDSS resource v_da07fe19-d0bc-4451-a0c5-29df607f9b02 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] delete target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] delete target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] failed to remove resource iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 because of JDSS resource iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] deleating volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] get snapshots for volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] get volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_da07fe19-d0bc-4451-a0c5-29df607f9b02', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437901', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110284', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14232207134990815961', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c9b125b74856a34f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293800960', 'san:volume_id': 'c9b125b74856a34fa8e84e12896bc955a97c8308', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81514', 'name': 'v_da07fe19-d0bc-4451-a0c5-29df607f9b02', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] delete volume:v_da07fe19-d0bc-4451-a0c5-29df607f9b02 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=26,cinder:SELECT=60,cinder:INSERT=10,cinder:DELETE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] remove_export for volume: 296c91ea-5012-40ab-8aa9-88c734a03de7. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-999044072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a00e06-ff5e-4f16-bb65-25e520b983dd,host='user@joviandss-2#joviandss-2',id=296c91ea-5012-40ab-8aa9-88c734a03de7,launched_at=2023-04-14T01:44:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bc4ea12df147e9b7662ec354ae7cb3',provider_auth='CHAP opcCYBqu Lgc2Hr7QTZ8wut',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:30Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T01:44:37Z,use_quota=True,user_id='ac5bc15e8b994c159dd9a011a26ef648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efa9f958-d793-4247-b2e2-ec9708dd0f5e),volume_type_id=efa9f958-d793-4247-b2e2-ec9708dd0f5e) from target:iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] detach volume v_296c91ea-5012-40ab-8aa9-88c734a03de7 from target iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7/luns/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7/luns/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7/luns/v_296c91ea-5012-40ab-8aa9-88c734a03de7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7/luns/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] failed to remove resource iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 because of JDSS resource v_296c91ea-5012-40ab-8aa9-88c734a03de7 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] delete target: iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] delete target iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] failed to remove resource iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 because of JDSS resource iqn.2010-10.org.openstack:296c91ea-5012-40ab-8aa9-88c734a03de7 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] deleating volume v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] get snapshots for volume v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] create export for volume: 7298e05a-b142-4365-95e1-f8551de0ae79. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] ensure volume 7298e05a-b142-4365-95e1-f8551de0ae79 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] check if targe iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] create target and attach volume 7298e05a-b142-4365-95e1-f8551de0ae79 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] create target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] get volume v_296c91ea-5012-40ab-8aa9-88c734a03de7 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_296c91ea-5012-40ab-8aa9-88c734a03de7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438079', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110481', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12754905007790695210', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '567366300a96c9c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293800960', 'san:volume_id': '567366300a96c9c8f66c522f5392a546eac33eca', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81012', 'name': 'v_296c91ea-5012-40ab-8aa9-88c734a03de7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] delete volume:v_296c91ea-5012-40ab-8aa9-88c734a03de7 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (e40c0b3b-3d92-4dad-b904-7a9ef914ff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee20ef8d-7929-4b9d-943d-5026b404b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee20ef8d-7929-4b9d-943d-5026b404b6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4ab38ffd-6daf-4153-b3eb-8817849e499d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9407ec8e-7fa7-49e3-81a0-e6659fd98f5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:38Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80cb21b-56ba-456d-8dbf-f4e6afcf6afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80cb21b-56ba-456d-8dbf-f4e6afcf6afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192accec-c403-4659-8f4b-adb0a45ce6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192accec-c403-4659-8f4b-adb0a45ce6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ab38ffd-6daf-4153-b3eb-8817849e499d', 'volume_name': 'volume-4ab38ffd-6daf-4153-b3eb-8817849e499d', 'volume_size': 1, 'snapshot_id': '9407ec8e-7fa7-49e3-81a0-e6659fd98f5d'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca442cf6-565c-4304-9850-fa4401e23dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca442cf6-565c-4304-9850-fa4401e23dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705a47b0-30f8-450a-acc8-27321e64b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:38 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Volume 4ab38ffd-6daf-4153-b3eb-8817849e499d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ab38ffd-6daf-4153-b3eb-8817849e499d', 'volume_size': 1, 'snapshot_id': '9407ec8e-7fa7-49e3-81a0-e6659fd98f5d'} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] create volume 4ab38ffd-6daf-4153-b3eb-8817849e499d from snapshot 9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] cloning s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d to v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] create snapshot v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da07fe19-d0bc-4451-a0c5-29df607f9b02 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] volume v_da07fe19-d0bc-4451-a0c5-29df607f9b02 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.quota [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Created reservations ['4f9e2b59-6731-4709-8343-d4609bb81368', '243b7430-b437-47c1-89d8-5dbba40e7bd1', '4ac70e58-c43d-4637-a3cd-078cb5bf4a68', 'c75e9f4a-1e47-4c1b-ae03-eb4ea8d92cb8'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_4ab38ffd-6daf-4153-b3eb-8817849e499d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] create volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d from snapshot v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Acquiring lock "cinder-953520b1-6ecb-41ad-8793-851901048f6d-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-953520b1-6ecb-41ad-8793-851901048f6d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] remove_export for volume: 953520b1-6ecb-41ad-8793-851901048f6d. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-137866865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=953520b1-6ecb-41ad-8793-851901048f6d,launched_at=2023-04-14T01:41:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth='CHAP TXlNnZyv oFqc96D5UzXi4G',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:28Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:44:40Z,updated_at=2023-04-14T01:44:40Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] detach volume v_953520b1-6ecb-41ad-8793-851901048f6d from target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293940224', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.manager [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:39 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Deleted volume successfully. Apr 14 01:44:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4caa5a86-29a3-4171-baa1-0dd7ac92d80f tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-da07fe19-d0bc-4451-a0c5-29df607f9b02-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d@v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'is_clone': True, 'full_name': 'Pool-0/v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'name': 'v_4ab38ffd-6daf-4153-b3eb-8817849e499d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] get volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_296c91ea-5012-40ab-8aa9-88c734a03de7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] volume v_296c91ea-5012-40ab-8aa9-88c734a03de7 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] remove_export for volume: ce111437-8ae3-434b-9449-99264333f13f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578141108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a00e06-ff5e-4f16-bb65-25e520b983dd,host='user@joviandss-2#joviandss-2',id=ce111437-8ae3-434b-9449-99264333f13f,launched_at=2023-04-14T01:44:33Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bc4ea12df147e9b7662ec354ae7cb3',provider_auth='CHAP TygjQfdW hqfinRk9u4gDOm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:31Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T01:44:37Z,use_quota=True,user_id='ac5bc15e8b994c159dd9a011a26ef648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efa9f958-d793-4247-b2e2-ec9708dd0f5e),volume_type_id=efa9f958-d793-4247-b2e2-ec9708dd0f5e) from target:iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] detach volume v_ce111437-8ae3-434b-9449-99264333f13f from target iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f/luns/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f/luns/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d@v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438088', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110503', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12053510212643435953', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8755e0a3c59290ab', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293891072', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82560', 'name': 'v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f/luns/v_ce111437-8ae3-434b-9449-99264333f13f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f/luns/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] failed to remove resource iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f because of JDSS resource v_ce111437-8ae3-434b-9449-99264333f13f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] delete target: iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] delete target iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Marking volume 4ab38ffd-6daf-4153-b3eb-8817849e499d as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Copying metadata from snapshot 9407ec8e-7fa7-49e3-81a0-e6659fd98f5d to 4ab38ffd-6daf-4153-b3eb-8817849e499d. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] failed to remove resource iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f because of JDSS resource iqn.2010-10.org.openstack:ce111437-8ae3-434b-9449-99264333f13f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] deleating volume v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] get snapshots for volume v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] atach volume v_7298e05a-b142-4365-95e1-f8551de0ae79 to target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns/v_953520b1-6ecb-41ad-8793-851901048f6d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d/luns/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] failed to remove resource iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d because of JDSS resource v_953520b1-6ecb-41ad-8793-851901048f6d DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] delete target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] delete target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705a47b0-30f8-450a-acc8-27321e64b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab38ffd-6daf-4153-b3eb-8817849e499d', 'volume_size': 1, 'snapshot_id': '9407ec8e-7fa7-49e3-81a0-e6659fd98f5d'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9628791-1c6b-4e02-8e4b-1cfb66e68e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=64,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=16 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:40 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Volume volume-4ab38ffd-6daf-4153-b3eb-8817849e499d (4ab38ffd-6daf-4153-b3eb-8817849e499d): created successfully Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9628791-1c6b-4e02-8e4b-1cfb66e68e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (e40c0b3b-3d92-4dad-b904-7a9ef914ff87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:40 user cinder-volume[73579]: INFO cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-2af5015e-e5b1-4b85-81c3-cab5fc41d7ea tempest-TestVolumeBootPattern-224521177 None] Created volume successfully. Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] get volume v_ce111437-8ae3-434b-9449-99264333f13f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ce111437-8ae3-434b-9449-99264333f13f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438081', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110487', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6249729380312432723', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '59a4f45d27783681', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293878784', 'san:volume_id': '59a4f45d27783681bb91bcd2719eb3d0fbc7534d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82433', 'name': 'v_ce111437-8ae3-434b-9449-99264333f13f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] delete volume:v_ce111437-8ae3-434b-9449-99264333f13f recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6461643666363838', 'lun': 0, 'mode': 'wt', 'name': 'v_7298e05a-b142-4365-95e1-f8551de0ae79', 'prod_id': 'Storage', 'scsi_id': 'dad6f688d3177bf7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] add credentails to target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] failed to remove resource iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d because of JDSS resource iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] deleating volume v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] get snapshots for volume v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 201, 'error': None, 'data': {'name': 'nmkLiNCj'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] initialize_connection for 7298e05a-b142-4365-95e1-f8551de0ae79 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:44:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmkLiNCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'cca51a1e-a7f1-4078-bada-b708a9819bf2'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:44:42 user cinder-volume[73579]: INFO cinder.volume.manager [req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa req-b8456474-7880-4c97-9c98-3ca4e21bf6ed tempest-ServerStableDeviceRescueTest-131403183 None] attachment_update completed successfully. Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] get volume v_953520b1-6ecb-41ad-8793-851901048f6d info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_953520b1-6ecb-41ad-8793-851901048f6d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437898', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110271', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10698927256430762038', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a6a63145e255a6c6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293960704', 'san:volume_id': 'a6a63145e255a6c6d3d02797caf5b4fd998a7cfc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81490', 'name': 'v_953520b1-6ecb-41ad-8793-851901048f6d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] delete volume:v_953520b1-6ecb-41ad-8793-851901048f6d recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce111437-8ae3-434b-9449-99264333f13f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] volume v_ce111437-8ae3-434b-9449-99264333f13f deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.quota [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Created reservations ['aa2bd178-d0d7-4df0-bc46-38c951ff9384'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:42 user cinder-volume[73579]: WARNING cinder.quota [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-434724734 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-434724734, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:44:42 user cinder-volume[73579]: WARNING cinder.quota [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-434724734 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-434724734, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.quota [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Created reservations ['6d0dd6dc-69cb-4c3a-a20c-dda284c1a56f', 'b2a971d6-8bac-4b60-976f-ce990b5c8d2b', '302e963e-1d6e-48b9-a938-fd003fd6037c', '4031fbb6-9da0-488e-8bb9-f0588b57b743'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=60,cinder:INSERT=16,cinder:UPDATE=24 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.quota [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Created reservations ['ce8c77d4-f3c7-43b9-ae41-96d319501598', '42f8e610-8fe0-4efe-a320-cadcde6861c0', '95047f0e-0b3c-4458-8cda-781c3ca8d73b', '26cd608b-405c-448c-81c1-fd0cc320bb0c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] create export for volume: 4ab38ffd-6daf-4153-b3eb-8817849e499d. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] ensure volume 4ab38ffd-6daf-4153-b3eb-8817849e499d assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] check if targe iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293960704', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:43 user cinder-volume[73579]: DEBUG cinder.manager [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f7ef7d78-2466-4d39-bafa-5e598be13e91 tempest-GroupsTest-2025235028 None] Delete group completed successfully. Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_953520b1-6ecb-41ad-8793-851901048f6d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] volume v_953520b1-6ecb-41ad-8793-851901048f6d deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] create target and attach volume 4ab38ffd-6daf-4153-b3eb-8817849e499d to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] create target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:44 user cinder-volume[73579]: DEBUG cinder.quota [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Created reservations ['e1b0ebba-19b8-46e3-a91a-052b2076dc9b', 'b641bcf1-08a4-49c2-b3f3-e6fa3414c936', '0246050f-2cf8-4e1f-8487-3e4d7e1ed8e8', 'a933531f-a3c4-4509-85ca-2325de3351e7'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Acquiring lock "cinder-5e9b1e2c-15a4-481a-a713-fa24dca0918e-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-5e9b1e2c-15a4-481a-a713-fa24dca0918e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] remove_export for volume: 5e9b1e2c-15a4-481a-a713-fa24dca0918e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2085378583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e9b1e2c-15a4-481a-a713-fa24dca0918e,launched_at=2023-04-14T01:41:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113733a7b1f9424bb5243107472b01c6',provider_auth='CHAP oLYPhWbV XUk1DIEgQ5ZqrF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:02Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:44:45Z,updated_at=2023-04-14T01:44:45Z,use_quota=True,user_id='692d1dd6aa73472a9c63049910360a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] detach volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e from target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e/luns/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] failed to remove resource iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e because of JDSS resource v_5e9b1e2c-15a4-481a-a713-fa24dca0918e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] delete target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] delete target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] failed to remove resource iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e because of JDSS resource iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] deleating volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] get snapshots for volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] get volume v_5e9b1e2c-15a4-481a-a713-fa24dca0918e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437895', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '110254', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5424910070308888832', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '8f9b731f51931d7a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294054912', 'san:volume_id': '8f9b731f51931d7ad0ba15aa7a268781bd694e4c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '81441', 'name': 'v_5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] delete snapshot v_5e9b1e2c-15a4-481a-a713-fa24dca0918e of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_5e9b1e2c-15a4-481a-a713-fa24dca0918e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] snapshot v_5e9b1e2c-15a4-481a-a713-fa24dca0918e deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.quota [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Created reservations ['974db897-463d-4b02-bec5-66af599989f9', 'ff994b05-ec16-42e1-ad3c-3f3686b8e889', 'fcec880f-7ff7-4798-b570-50f50492c0ed', '64192235-da66-4413-b824-aa9dbd51dc89'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] atach volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d to target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293960704', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:47 user cinder-volume[73579]: DEBUG cinder.manager [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:47 user cinder-volume[73579]: INFO cinder.volume.manager [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Deleted volume successfully. Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-aadb87bf-acff-4c98-a60f-6d513930a058 tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-953520b1-6ecb-41ad-8793-851901048f6d-delete_volume" released by "delete_volume" :: held 8.423s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304270336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.manager [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:44:48 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Deleted volume successfully. Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5422b8b1-2b85-480d-9da7-9ea7317f8f11 tempest-TaggedBootDevicesTest-135372045 None] Lock "cinder-5e9b1e2c-15a4-481a-a713-fa24dca0918e-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Flow 'volume_create_manager' (d24edc8a-685a-437b-bc6d-0cea2c268de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bad7e8-6d02-497d-9b31-8c7cfc71a59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bad7e8-6d02-497d-9b31-8c7cfc71a59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-836919459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5110a981-ed2e-45b3-bbeb-4f944481fad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980232bde0c443d886e2a005d3e6fb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:44:49Z,use_quota=True,user_id='23b24b49a336453abd72dbd811d437f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8407df68-e9b5-4ac0-b91f-a848e2d60f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8407df68-e9b5-4ac0-b91f-a848e2d60f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd1520e-14a8-432c-8820-1287463d1dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd1520e-14a8-432c-8820-1287463d1dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5110a981-ed2e-45b3-bbeb-4f944481fad2', 'volume_name': 'volume-5110a981-ed2e-45b3-bbeb-4f944481fad2', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4195174-8cd2-49c6-ba9b-d40fbd505284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4195174-8cd2-49c6-ba9b-d40fbd505284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689eec5e-6f4d-4a13-8503-f045ffa6d7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:48 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Volume 5110a981-ed2e-45b3-bbeb-4f944481fad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5110a981-ed2e-45b3-bbeb-4f944481fad2', 'volume_size': 1} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] creating volume v_5110a981-ed2e-45b3-bbeb-4f944481fad2. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] create volume {'name': 'v_5110a981-ed2e-45b3-bbeb-4f944481fad2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3837353565306133', 'lun': 0, 'mode': 'wt', 'name': 'v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'prod_id': 'Storage', 'scsi_id': '8755e0a3c59290ab'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] add credentails to target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5110a981-ed2e-45b3-bbeb-4f944481fad2', 'is_clone': False, 'name': 'v_5110a981-ed2e-45b3-bbeb-4f944481fad2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'name': 'LsEAhbUg'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689eec5e-6f4d-4a13-8503-f045ffa6d7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5110a981-ed2e-45b3-bbeb-4f944481fad2', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864ad6f0-894d-4aa7-b815-cff8c9a85a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:DELETE=1,cinder:SELECT=57,cinder:UPDATE=37,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] initialize_connection for 4ab38ffd-6daf-4153-b3eb-8817849e499d 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:44:49 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Volume volume-5110a981-ed2e-45b3-bbeb-4f944481fad2 (5110a981-ed2e-45b3-bbeb-4f944481fad2): created successfully Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864ad6f0-894d-4aa7-b815-cff8c9a85a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Flow 'volume_create_manager' (d24edc8a-685a-437b-bc6d-0cea2c268de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:44:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-75f06c6d-b384-4a61-9b7b-e3836d7dd8cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Created volume successfully. Apr 14 01:44:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsEAhbUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'abb9a434-5221-494f-8d94-29fc7a6941ab'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:44:49 user cinder-volume[73579]: INFO cinder.volume.manager [req-c2d6a361-0921-44f9-8ee5-1616db41d24d req-82dce310-140e-4350-b754-c8f2a8cc3a34 tempest-TestVolumeBootPattern-224521177 None] attachment_update completed successfully. Apr 14 01:44:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] create snapshot c4fb6a8c-3574-4e58-9a07-f71b5e79560c for volume 5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:44:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] cloning v_5110a981-ed2e-45b3-bbeb-4f944481fad2 to s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:44:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] create snapshot s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:44:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c4fb6a8c-3574-4e58-9a07-f71b5e79560c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] create volume s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c from snapshot s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:44:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5110a981-ed2e-45b3-bbeb-4f944481fad2@s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c', 'is_clone': True, 'full_name': 'Pool-0/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c', 'name': 's_c4fb6a8c-3574-4e58-9a07-f71b5e79560c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] volume s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:44:53 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d3b140dd-5144-41e9-b7cb-0ba9b02d8028 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Create snapshot completed successfully Apr 14 01:44:54 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Acquiring lock "cinder-c4fb6a8c-3574-4e58-9a07-f71b5e79560c-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:54 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Lock "cinder-c4fb6a8c-3574-4e58-9a07-f71b5e79560c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] deleating snapshot s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:44:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] get snapshots for volume s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] get volume s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5110a981-ed2e-45b3-bbeb-4f944481fad2@s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438101', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110525', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1382166589752069562', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c8ca48605c8491b0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304188416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81964', 'name': 's_c4fb6a8c-3574-4e58-9a07-f71b5e79560c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] delete snapshot s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c of volume v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots/s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] snapshot s_c4fb6a8c-3574-4e58-9a07-f71b5e79560c deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:44:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:INSERT=9,cinder:SELECT=54,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:56 user cinder-volume[73579]: DEBUG cinder.quota [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Created reservations ['5f8407b6-59de-4c19-a661-7648026024d1', 'bcd69b06-a0c1-47ba-b87c-94c18a2f278d', '32137839-db75-45ff-910d-b69c26430a51', '0c5f4405-1739-4eab-af7d-57d154808f30'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:44:56 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Delete snapshot completed successfully. Apr 14 01:44:56 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a03fb8d3-1744-4bde-9ebd-ff7a3d0b61a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Lock "cinder-c4fb6a8c-3574-4e58-9a07-f71b5e79560c-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Acquiring lock "cinder-5110a981-ed2e-45b3-bbeb-4f944481fad2-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Lock "cinder-5110a981-ed2e-45b3-bbeb-4f944481fad2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] remove_export for volume: 5110a981-ed2e-45b3-bbeb-4f944481fad2. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-836919459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5110a981-ed2e-45b3-bbeb-4f944481fad2,launched_at=2023-04-14T01:44:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980232bde0c443d886e2a005d3e6fb5e',provider_auth='CHAP RPydzYbM CQpyzHtgo23Fl1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:49Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:44:58Z,updated_at=2023-04-14T01:44:58Z,use_quota=True,user_id='23b24b49a336453abd72dbd811d437f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] detach volume v_5110a981-ed2e-45b3-bbeb-4f944481fad2 from target iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2/luns/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2/luns/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2/luns/v_5110a981-ed2e-45b3-bbeb-4f944481fad2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2/luns/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] failed to remove resource iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 because of JDSS resource v_5110a981-ed2e-45b3-bbeb-4f944481fad2 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] delete target: iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] delete target iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] failed to remove resource iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 because of JDSS resource iqn.2010-10.org.openstack:5110a981-ed2e-45b3-bbeb-4f944481fad2 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] deleating volume v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:44:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] get snapshots for volume v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] get volume v_5110a981-ed2e-45b3-bbeb-4f944481fad2 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5110a981-ed2e-45b3-bbeb-4f944481fad2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438098', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110519', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13891433610481944009', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bdae188e70164b23', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304188416', 'san:volume_id': 'bdae188e70164b230bb8e5decab4be5d870bd393', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81782', 'name': 'v_5110a981-ed2e-45b3-bbeb-4f944481fad2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] delete volume:v_5110a981-ed2e-45b3-bbeb-4f944481fad2 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:44:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Acquiring lock "cinder-217c01bb-a21b-4ff9-9e57-99dba019914b-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Lock "cinder-217c01bb-a21b-4ff9-9e57-99dba019914b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] remove_export for volume: 217c01bb-a21b-4ff9-9e57-99dba019914b. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1011104471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=217c01bb-a21b-4ff9-9e57-99dba019914b,launched_at=2023-04-14T01:41:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f0122cc9864fcea660891e2826ca7b',provider_auth='CHAP YbsqhwAf qOjNixEkMPCW7Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:03Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:00Z,updated_at=2023-04-14T01:45:00Z,use_quota=True,user_id='2bada5cdb7704f6b956eb48b3729388d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] detach volume v_217c01bb-a21b-4ff9-9e57-99dba019914b from target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns/v_217c01bb-a21b-4ff9-9e57-99dba019914b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b/luns/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] failed to remove resource iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b because of JDSS resource v_217c01bb-a21b-4ff9-9e57-99dba019914b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] delete target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] delete target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] failed to remove resource iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b because of JDSS resource iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] deleating volume v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] get snapshots for volume v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5110a981-ed2e-45b3-bbeb-4f944481fad2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] volume v_5110a981-ed2e-45b3-bbeb-4f944481fad2 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.quota [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Created reservations ['694c3fdd-1fa7-49d2-946d-07d6cac380f2', 'd9a6bf53-788f-47b6-89d6-034c7bf6604a', '82b45962-fb1f-4f79-a29e-24a4f4ab26a0', '527422ec-64b1-4c1f-9681-025487713617'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] get volume v_217c01bb-a21b-4ff9-9e57-99dba019914b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_217c01bb-a21b-4ff9-9e57-99dba019914b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437873', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110208', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5813210558419953335', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0c80c644cc7a541f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304270336', 'san:volume_id': '0c80c644cc7a541f607db94bf353c63f1201fdbc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81921', 'name': 'v_217c01bb-a21b-4ff9-9e57-99dba019914b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] delete volume:v_217c01bb-a21b-4ff9-9e57-99dba019914b recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304270336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:01 user cinder-volume[73579]: DEBUG cinder.manager [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:01 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Deleted volume successfully. Apr 14 01:45:01 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0663d476-b681-4abb-9f6f-0554d21e79c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1421661977 None] Lock "cinder-5110a981-ed2e-45b3-bbeb-4f944481fad2-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_217c01bb-a21b-4ff9-9e57-99dba019914b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] volume v_217c01bb-a21b-4ff9-9e57-99dba019914b deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:03 user cinder-volume[73579]: DEBUG cinder.quota [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Created reservations ['5b3f840c-4e3f-4e00-b54c-f91f0609ddfb', 'e23299ee-57a3-4092-b2f8-ed2438a2e8c1', '8a4b02c1-44f6-4bce-b5ea-fe91d1908d1d', 'b2f98275-ba3a-470e-8e82-16b7c6cb9ff0'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304364544', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.manager [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Deleted volume successfully. Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-59211619-cf98-4817-93fd-eaed6f0a00df tempest-TaggedAttachmentsTest-242857735 None] Lock "cinder-217c01bb-a21b-4ff9-9e57-99dba019914b-delete_volume" released by "delete_volume" :: held 4.232s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Flow 'volume_create_manager' (7e171e88-a3c5-4b91-b6f4-c8156e4e880b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7977006-84e6-4561-ac1a-8191ad5430e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7977006-84e6-4561-ac1a-8191ad5430e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c582c493-1820-4af5-80a4-ed525f9ee2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a6865a27314dcebeead4c56d9ca65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:45:05Z,use_quota=True,user_id='0fafae2af7174367bce80fc99dcdfb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7844486e-2c90-4fdd-ad0b-028d73e89d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7844486e-2c90-4fdd-ad0b-028d73e89d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc72860-7c5c-4dc5-b571-06e43c6ba9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc72860-7c5c-4dc5-b571-06e43c6ba9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c582c493-1820-4af5-80a4-ed525f9ee2be', 'volume_name': 'volume-c582c493-1820-4af5-80a4-ed525f9ee2be', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c279cbd0-37dc-4c77-89a4-d847339bb941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c279cbd0-37dc-4c77-89a4-d847339bb941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d725e4-386e-4450-84d8-bf7213b80c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:04 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Volume c582c493-1820-4af5-80a4-ed525f9ee2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c582c493-1820-4af5-80a4-ed525f9ee2be', 'volume_size': 1} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] creating volume v_c582c493-1820-4af5-80a4-ed525f9ee2be. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] create volume {'name': 'v_c582c493-1820-4af5-80a4-ed525f9ee2be', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c582c493-1820-4af5-80a4-ed525f9ee2be', 'is_clone': False, 'name': 'v_c582c493-1820-4af5-80a4-ed525f9ee2be'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d725e4-386e-4450-84d8-bf7213b80c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c582c493-1820-4af5-80a4-ed525f9ee2be', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714a658d-a0a4-46f8-8b5d-4995519dfac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:05 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Volume volume-c582c493-1820-4af5-80a4-ed525f9ee2be (c582c493-1820-4af5-80a4-ed525f9ee2be): created successfully Apr 14 01:45:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714a658d-a0a4-46f8-8b5d-4995519dfac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Flow 'volume_create_manager' (7e171e88-a3c5-4b91-b6f4-c8156e4e880b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-63c07797-72f6-4bee-93b6-ef9044c95db7 tempest-CinderUnicodeTest-1951078009 None] Created volume successfully. Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Flow 'volume_create_manager' (4dc55cc4-7cde-4da4-804d-dbfeafa9e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc0674c-3f3b-40f0-9881-7ba35a8abb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc0674c-3f3b-40f0-9881-7ba35a8abb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-199118785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a8cb8551-618b-4c0f-89ee-9cf09a64f878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a6865a27314dcebeead4c56d9ca65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:45:07Z,use_quota=True,user_id='0fafae2af7174367bce80fc99dcdfb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fc5d2a-7abe-4c92-b020-1f936f557537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fc5d2a-7abe-4c92-b020-1f936f557537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6852552-1ba8-4238-869b-2abaec9e3e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6852552-1ba8-4238-869b-2abaec9e3e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'volume_name': 'volume-a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f54e736-8a9d-4936-bada-694004b48a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f54e736-8a9d-4936-bada-694004b48a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadb29d8-169e-4b89-9651-53479d92bd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:07 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Volume a8cb8551-618b-4c0f-89ee-9cf09a64f878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'volume_size': 1} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] creating volume v_a8cb8551-618b-4c0f-89ee-9cf09a64f878. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] create volume {'name': 'v_a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'is_clone': False, 'name': 'v_a8cb8551-618b-4c0f-89ee-9cf09a64f878'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadb29d8-169e-4b89-9651-53479d92bd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3835a7-3e4f-45ec-b357-f81094785807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:08 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Volume volume-a8cb8551-618b-4c0f-89ee-9cf09a64f878 (a8cb8551-618b-4c0f-89ee-9cf09a64f878): created successfully Apr 14 01:45:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3835a7-3e4f-45ec-b357-f81094785807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Flow 'volume_create_manager' (4dc55cc4-7cde-4da4-804d-dbfeafa9e8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6346ca6d-14fb-4715-bf54-dd8044670dd4 tempest-CinderUnicodeTest-1951078009 None] Created volume successfully. Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Acquiring lock "cinder-6c338230-59bf-4755-bdd9-5e2f28dc339f-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Lock "cinder-6c338230-59bf-4755-bdd9-5e2f28dc339f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=58,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] remove_export for volume: 6c338230-59bf-4755-bdd9-5e2f28dc339f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-543453012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6c338230-59bf-4755-bdd9-5e2f28dc339f,launched_at=2023-04-14T01:42:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4910c626438f42e9a5db828ae4dae86c',provider_auth='CHAP OsWvmnqc ExfGyZUvkm6uj1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:17Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:09Z,updated_at=2023-04-14T01:45:09Z,use_quota=True,user_id='8ebae9b1685f46aea0064cf83813e4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] detach volume v_6c338230-59bf-4755-bdd9-5e2f28dc339f from target iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f/luns/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f/luns/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f/luns/v_6c338230-59bf-4755-bdd9-5e2f28dc339f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f/luns/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] failed to remove resource iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f because of JDSS resource v_6c338230-59bf-4755-bdd9-5e2f28dc339f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] delete target: iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] delete target iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] failed to remove resource iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f because of JDSS resource iqn.2010-10.org.openstack:6c338230-59bf-4755-bdd9-5e2f28dc339f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] deleating volume v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] get snapshots for volume v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] create snapshot 7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 for volume a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] cloning v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 to s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] create snapshot s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] get volume v_6c338230-59bf-4755-bdd9-5e2f28dc339f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6c338230-59bf-4755-bdd9-5e2f28dc339f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437947', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110369', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9557470790047838136', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0d6ba90c9888d52c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294140928', 'san:volume_id': '0d6ba90c9888d52c475a457af108955b4ae26bce', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82177', 'name': 'v_6c338230-59bf-4755-bdd9-5e2f28dc339f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] delete volume:v_6c338230-59bf-4755-bdd9-5e2f28dc339f recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] create volume s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 from snapshot s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878@s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317', 'is_clone': True, 'full_name': 'Pool-0/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317', 'name': 's_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] volume s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:45:11 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2a567b17-764a-4e73-ad4d-92cb7e4eb5c9 tempest-CinderUnicodeTest-1951078009 None] Create snapshot completed successfully Apr 14 01:45:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c338230-59bf-4755-bdd9-5e2f28dc339f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] volume v_6c338230-59bf-4755-bdd9-5e2f28dc339f deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.quota [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Created reservations ['b7bee601-5c8b-4390-b214-6161c3001f5a', '34054f85-5fc5-469e-a07b-7ba849cfb8a0', '2e87e45b-9ce5-4a54-9c14-86c827df60ce', '33152c61-0eee-4508-93be-e46d5053d62c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294083584', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.manager [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:12 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Deleted volume successfully. Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4c707521-f4fe-43aa-8216-7473a3c7d52b tempest-VolumesNegativeTest-116646311 None] Lock "cinder-6c338230-59bf-4755-bdd9-5e2f28dc339f-delete_volume" released by "delete_volume" :: held 3.612s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Acquiring lock "cinder-7ee212a0-3f6d-42ff-9afb-bf62ab0cb317-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Lock "cinder-7ee212a0-3f6d-42ff-9afb-bf62ab0cb317-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] deleating snapshot s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] get snapshots for volume s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] get volume s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878@s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438120', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110546', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8978842628364557784', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f0d3398f5b9dac8b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294083584', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82700', 'name': 's_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] delete snapshot s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 of volume v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots/s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] snapshot s_7ee212a0-3f6d-42ff-9afb-bf62ab0cb317 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.quota [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Created reservations ['620a5286-196b-4507-8549-fe0542f6b64d', '582921ac-4579-4ea7-9980-611786a9fe58', 'c247708f-ffaa-4d69-bfeb-8ce664072b00', 'b3bb4067-040e-43ec-83a8-06a243ae40f6'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:15 user cinder-volume[73579]: INFO cinder.volume.manager [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Delete snapshot completed successfully. Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.coordination [None req-10f27129-9172-47ef-8c38-2d2e8b867e5e tempest-CinderUnicodeTest-1951078009 None] Lock "cinder-7ee212a0-3f6d-42ff-9afb-bf62ab0cb317-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Flow 'volume_create_manager' (fa995b7a-4fb1-4f2b-9aa4-4a5809611c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab968d48-4345-49c5-8c7d-abb979440571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab968d48-4345-49c5-8c7d-abb979440571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-697093130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5374d5e3-6123-403a-ad4e-54e04fd3f7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cecc332f22a40c19cb50a112416872f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:45:15Z,use_quota=True,user_id='0c391431bcad4faabd9073f209c0fa89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d951c6df-3034-4f53-8c46-28fa95ddb169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d951c6df-3034-4f53-8c46-28fa95ddb169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f368752-0c63-42f5-9041-9990280c888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f368752-0c63-42f5-9041-9990280c888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'volume_name': 'volume-5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'volume_size': 2}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e899da-4a35-4f3a-ae1d-2edd775c6f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e899da-4a35-4f3a-ae1d-2edd775c6f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb2b9d1-da1c-4dbf-a087-bcbdd53f3838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:15 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Volume 5374d5e3-6123-403a-ad4e-54e04fd3f7fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'volume_size': 2} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] creating volume v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] create volume {'name': 'v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Acquiring lock "cinder-a8cb8551-618b-4c0f-89ee-9cf09a64f878-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Lock "cinder-a8cb8551-618b-4c0f-89ee-9cf09a64f878-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] remove_export for volume: a8cb8551-618b-4c0f-89ee-9cf09a64f878. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-199118785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a8cb8551-618b-4c0f-89ee-9cf09a64f878,launched_at=2023-04-14T01:45:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a6865a27314dcebeead4c56d9ca65c',provider_auth='CHAP FIslHeDo 60LArVNDSZgnXT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:07Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:16Z,updated_at=2023-04-14T01:45:16Z,use_quota=True,user_id='0fafae2af7174367bce80fc99dcdfb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] detach volume v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 from target iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878/luns/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878/luns/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878/luns/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878/luns/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] failed to remove resource iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 because of JDSS resource v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] delete target: iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] delete target iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] failed to remove resource iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 because of JDSS resource iqn.2010-10.org.openstack:a8cb8551-618b-4c0f-89ee-9cf09a64f878 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] deleating volume v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] get snapshots for volume v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'is_clone': False, 'name': 'v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb2b9d1-da1c-4dbf-a087-bcbdd53f3838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'volume_size': 2}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74d8588-26cc-4eed-86db-e5cd8db892ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:16 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Volume volume-5374d5e3-6123-403a-ad4e-54e04fd3f7fd (5374d5e3-6123-403a-ad4e-54e04fd3f7fd): created successfully Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74d8588-26cc-4eed-86db-e5cd8db892ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Flow 'volume_create_manager' (fa995b7a-4fb1-4f2b-9aa4-4a5809611c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2fdfe125-8fec-41d4-ba89-c678b0160e1a tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Created volume successfully. Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] get volume v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438117', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110540', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3165375699477712813', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a7900db2e9d05725', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293993472', 'san:volume_id': 'a7900db2e9d0572518d0038ffab9e8cc69c65522', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82688', 'name': 'v_a8cb8551-618b-4c0f-89ee-9cf09a64f878', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] delete volume:v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] create snapshot c2ea8600-5e29-4031-b2d0-83d8ea5fe68c for volume 5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:45:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] cloning v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd to s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:45:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] create snapshot s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:45:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] volume v_a8cb8551-618b-4c0f-89ee-9cf09a64f878 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:18 user cinder-volume[73579]: DEBUG cinder.quota [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Created reservations ['adae22f1-35f0-4c6b-8e51-22b6f88177b4', 'b8c14d82-2d9a-4311-93e8-24d82f846177', '7d499b61-e7ee-4587-a6cc-db9bbf394e26', 'e2845172-14a6-49e6-aab7-293b2927ed83'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] create volume s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c from snapshot s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Acquiring lock "cinder-c582c493-1820-4af5-80a4-ed525f9ee2be-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Lock "cinder-c582c493-1820-4af5-80a4-ed525f9ee2be-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] remove_export for volume: c582c493-1820-4af5-80a4-ed525f9ee2be. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c582c493-1820-4af5-80a4-ed525f9ee2be,launched_at=2023-04-14T01:45:06Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a6865a27314dcebeead4c56d9ca65c',provider_auth='CHAP jQZcmeWd cu09xLWTeIk8iF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:05Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:20Z,updated_at=2023-04-14T01:45:20Z,use_quota=True,user_id='0fafae2af7174367bce80fc99dcdfb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] detach volume v_c582c493-1820-4af5-80a4-ed525f9ee2be from target iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be/luns/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be/luns/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be/luns/v_c582c493-1820-4af5-80a4-ed525f9ee2be'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be/luns/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] failed to remove resource iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be because of JDSS resource v_c582c493-1820-4af5-80a4-ed525f9ee2be DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] delete target: iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] delete target iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] failed to remove resource iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be because of JDSS resource iqn.2010-10.org.openstack:c582c493-1820-4af5-80a4-ed525f9ee2be DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] deleating volume v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] get snapshots for volume v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294063104', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.manager [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:19 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Deleted volume successfully. Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f75ab170-90ea-4838-929e-260cee536ec4 tempest-CinderUnicodeTest-1951078009 None] Lock "cinder-a8cb8551-618b-4c0f-89ee-9cf09a64f878-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd@s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c', 'is_clone': True, 'full_name': 'Pool-0/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c', 'name': 's_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] volume s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:45:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-59e5d677-e197-4803-95d1-a0a32f8008e0 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Create snapshot completed successfully Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] get volume v_c582c493-1820-4af5-80a4-ed525f9ee2be info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c582c493-1820-4af5-80a4-ed525f9ee2be', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438114', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110535', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8750296183502853419', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '45449c22bc6935c6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294038528', 'san:volume_id': '45449c22bc6935c63f815313c32e57b83f4fbcb0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82083', 'name': 'v_c582c493-1820-4af5-80a4-ed525f9ee2be', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] delete volume:v_c582c493-1820-4af5-80a4-ed525f9ee2be recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Acquiring lock "cinder-c2ea8600-5e29-4031-b2d0-83d8ea5fe68c-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Lock "cinder-c2ea8600-5e29-4031-b2d0-83d8ea5fe68c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] deleating snapshot s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] get snapshots for volume s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] get volume s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd@s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438128', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110562', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2854282478593132378', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9168e216f8b545ce', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294108160', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82735', 'name': 's_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] delete snapshot s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c of volume v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c582c493-1820-4af5-80a4-ed525f9ee2be {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] volume v_c582c493-1820-4af5-80a4-ed525f9ee2be deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.quota [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Created reservations ['e6e5f9df-91d5-4e3e-be63-be4e72a57bf4', '4b90e9c8-6aa6-4604-b41f-8891d0c23855', '7c1cac21-73ea-4c7a-82c5-92cc9f056c17', '483ca43b-ef46-48d4-a444-88c3eeae14f7'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=59,cinder:DELETE=3,cinder:INSERT=7,cinder:UPDATE=31 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294095872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.manager [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Deleted volume successfully. Apr 14 01:45:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-85fc0828-a173-4d3a-9436-877d3d85932e tempest-CinderUnicodeTest-1951078009 None] Lock "cinder-c582c493-1820-4af5-80a4-ed525f9ee2be-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots/s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] snapshot s_c2ea8600-5e29-4031-b2d0-83d8ea5fe68c deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:45:23 user cinder-volume[73579]: DEBUG cinder.quota [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Created reservations ['d374e43b-5805-43b4-8fb9-a827b412765b', '90078085-36db-482c-babb-4a9b6f41a11e', '472e558f-67c0-4eb1-8624-7f80a5a1a200', '363754b3-e25a-4817-bc85-a8c7b3673830'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:23 user cinder-volume[73579]: INFO cinder.volume.manager [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Delete snapshot completed successfully. Apr 14 01:45:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87904b13-9072-4b7c-a579-08d9194f253f tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Lock "cinder-c2ea8600-5e29-4031-b2d0-83d8ea5fe68c-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Acquiring lock "cinder-ddd73274-308f-4d71-9930-9ed144269534-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Lock "cinder-ddd73274-308f-4d71-9930-9ed144269534-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] remove_export for volume: ddd73274-308f-4d71-9930-9ed144269534. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1182241430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ddd73274-308f-4d71-9930-9ed144269534,launched_at=2023-04-14T01:41:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e707623638044e983b557119edd7673',provider_auth='CHAP awmUAnKe zqpX82yDBvOtjH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:08Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:24Z,updated_at=2023-04-14T01:45:24Z,use_quota=True,user_id='f6e19e75aa9d4cda971c8d2449e85290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] detach volume v_ddd73274-308f-4d71-9930-9ed144269534 from target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns/v_ddd73274-308f-4d71-9930-9ed144269534'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534/luns/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] failed to remove resource iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 because of JDSS resource v_ddd73274-308f-4d71-9930-9ed144269534 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] delete target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] delete target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] failed to remove resource iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 because of JDSS resource iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] deleating volume v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] get snapshots for volume v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Acquiring lock "cinder-5374d5e3-6123-403a-ad4e-54e04fd3f7fd-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Lock "cinder-5374d5e3-6123-403a-ad4e-54e04fd3f7fd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] remove_export for volume: 5374d5e3-6123-403a-ad4e-54e04fd3f7fd. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-697093130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5374d5e3-6123-403a-ad4e-54e04fd3f7fd,launched_at=2023-04-14T01:45:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cecc332f22a40c19cb50a112416872f',provider_auth='CHAP XbePGJag 78VKHcOJASB6p3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:15Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:25Z,updated_at=2023-04-14T01:45:25Z,use_quota=True,user_id='0c391431bcad4faabd9073f209c0fa89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] detach volume v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd from target iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd/luns/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd/luns/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd/luns/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd/luns/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] failed to remove resource iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd because of JDSS resource v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] delete target: iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] delete target iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] failed to remove resource iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd because of JDSS resource iqn.2010-10.org.openstack:5374d5e3-6123-403a-ad4e-54e04fd3f7fd DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] deleating volume v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] get snapshots for volume v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] get volume v_ddd73274-308f-4d71-9930-9ed144269534 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ddd73274-308f-4d71-9930-9ed144269534', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437880', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110224', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12854846834326925381', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c0d46c7a31b1fba9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294120448', 'san:volume_id': 'c0d46c7a31b1fba9b1a49fbade5ee3fb1efb84cc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81838', 'name': 'v_ddd73274-308f-4d71-9930-9ed144269534', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] delete volume:v_ddd73274-308f-4d71-9930-9ed144269534 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] get volume v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438125', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110555', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10518292748069770674', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c0514f35aa42af15', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294120448', 'san:volume_id': 'c0514f35aa42af157f339f0769a26986107c9441', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82719', 'name': 'v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] delete volume:v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ddd73274-308f-4d71-9930-9ed144269534 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] volume v_ddd73274-308f-4d71-9930-9ed144269534 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.quota [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Created reservations ['998efec7-01f1-463f-b696-9fe70da44701', 'f136d381-9907-4a47-9cde-c81a70048ac1', '6fcaa038-ed5f-465c-908b-5b274e29ec60', 'c83f7e4e-a401-41a7-8d32-a3d2e2d0e8c0'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] volume v_5374d5e3-6123-403a-ad4e-54e04fd3f7fd deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.quota [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Created reservations ['e5dbf00f-fb3b-4fc7-8451-f67ae54da5e2', 'e01eefeb-2a6e-4525-b788-ee58ef4abb32', '39da0e4c-970e-45fd-8799-c670c23f926c', 'a4563301-8c86-4208-be10-e6abcf806b4e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294095872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.manager [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Deleted volume successfully. Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e25ee40e-23bc-4a28-a28c-3cb20e4680c3 tempest-VolumesSnapshotNegativeTestJSON-795172458 None] Lock "cinder-5374d5e3-6123-403a-ad4e-54e04fd3f7fd-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Acquiring lock "cinder-7113332c-fb29-4657-be57-be86d245b411-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Lock "cinder-7113332c-fb29-4657-be57-be86d245b411-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] remove_export for volume: 7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1868813248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7113332c-fb29-4657-be57-be86d245b411,launched_at=2023-04-14T01:41:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e707623638044e983b557119edd7673',provider_auth='CHAP TAEDvFux TUuYy1ZXriQIMv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:01Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:28Z,updated_at=2023-04-14T01:45:28Z,use_quota=True,user_id='f6e19e75aa9d4cda971c8d2449e85290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] detach volume v_7113332c-fb29-4657-be57-be86d245b411 from target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411/luns/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] failed to remove resource iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 because of JDSS resource v_7113332c-fb29-4657-be57-be86d245b411 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] delete target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] delete target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] failed to remove resource iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 because of JDSS resource iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] deleating volume v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] get snapshots for volume v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294284288', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.manager [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Deleted volume successfully. Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1ab19e79-bf8e-43c4-b9ac-5f4ac08ec199 tempest-TestVolumeSwap-755712300 None] Lock "cinder-ddd73274-308f-4d71-9930-9ed144269534-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] get volume v_7113332c-fb29-4657-be57-be86d245b411 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7113332c-fb29-4657-be57-be86d245b411', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437875', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110216', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6616152914861419762', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a25de1395f535ba4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294284288', 'san:volume_id': 'a25de1395f535ba40d64f118c13b59c3dacab135', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81939', 'name': 'v_7113332c-fb29-4657-be57-be86d245b411', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] delete volume:v_7113332c-fb29-4657-be57-be86d245b411 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7113332c-fb29-4657-be57-be86d245b411 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] volume v_7113332c-fb29-4657-be57-be86d245b411 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.quota [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Created reservations ['75911f79-5a03-4b1d-9660-892b9b7e3cb8', 'b00c6b73-13bd-4818-9f52-73725be13c18', 'b36012f1-f89d-4a31-9fed-1b4fb30e538c', '33e93413-183b-43d7-987c-36663f888c93'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114294284288', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:30 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294378496', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Deleted volume successfully. Apr 14 01:45:31 user cinder-volume[73579]: DEBUG cinder.coordination [None req-eb441d3b-6496-4957-b506-c736e30672c8 tempest-TestVolumeSwap-755712300 None] Lock "cinder-7113332c-fb29-4657-be57-be86d245b411-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:45 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=54,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Flow 'volume_create_manager' (7156a3c7-ca01-4e78-8a84-b69aa5a7947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ca0ba5-90c7-4fe2-bed5-6d9031d2f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ca0ba5-90c7-4fe2-bed5-6d9031d2f170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-846472401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6b005472-0fd9-4c6f-928b-6f16bbb13ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a409270d6d4d408de33c5e71a56da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:45:47Z,use_quota=True,user_id='bbaf843e44ff4359a15ab6d625134b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6210b6-b739-4159-8de4-14fdd3c4b2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6210b6-b739-4159-8de4-14fdd3c4b2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed83c478-c35a-4f94-88c5-b3d2bf202e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed83c478-c35a-4f94-88c5-b3d2bf202e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'volume_name': 'volume-6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44b519a-916a-46c8-845b-1a33961ff38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44b519a-916a-46c8-845b-1a33961ff38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510e3709-17a5-4ae9-bede-79d30dd2dba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:46 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Volume 6b005472-0fd9-4c6f-928b-6f16bbb13ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'volume_size': 1} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] creating volume v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] create volume {'name': 'v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'is_clone': False, 'name': 'v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510e3709-17a5-4ae9-bede-79d30dd2dba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0effb55-a8a9-4597-a22c-7d013264fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:45:48 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Volume volume-6b005472-0fd9-4c6f-928b-6f16bbb13ff1 (6b005472-0fd9-4c6f-928b-6f16bbb13ff1): created successfully Apr 14 01:45:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0effb55-a8a9-4597-a22c-7d013264fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:45:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Flow 'volume_create_manager' (7156a3c7-ca01-4e78-8a84-b69aa5a7947b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:45:48 user cinder-volume[73579]: INFO cinder.volume.manager [None req-41be7a52-f26a-4175-9e1b-ed0e784c222b tempest-VolumesAdminNegativeTest-1981219566 None] Created volume successfully. Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Acquiring lock "cinder-6b005472-0fd9-4c6f-928b-6f16bbb13ff1-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Lock "cinder-6b005472-0fd9-4c6f-928b-6f16bbb13ff1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] remove_export for volume: 6b005472-0fd9-4c6f-928b-6f16bbb13ff1. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-846472401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6b005472-0fd9-4c6f-928b-6f16bbb13ff1,launched_at=2023-04-14T01:45:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a409270d6d4d408de33c5e71a56da9',provider_auth='CHAP XhjMZecx mQ9IoJNyBpdAUf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:45:47Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:45:49Z,updated_at=2023-04-14T01:45:49Z,use_quota=True,user_id='bbaf843e44ff4359a15ab6d625134b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] detach volume v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 from target iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1/luns/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1/luns/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1/luns/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1/luns/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] failed to remove resource iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 because of JDSS resource v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] delete target: iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] delete target iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] failed to remove resource iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 because of JDSS resource iqn.2010-10.org.openstack:6b005472-0fd9-4c6f-928b-6f16bbb13ff1 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] deleating volume v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] get snapshots for volume v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] get volume v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438156', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110577', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12535904014160572503', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e50921a6a6d0e398', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294300672', 'san:volume_id': 'e50921a6a6d0e3980f4be3a3a1667e6a438ecae3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82827', 'name': 'v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] delete volume:v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:45:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] volume v_6b005472-0fd9-4c6f-928b-6f16bbb13ff1 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.quota [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Created reservations ['95bba110-c767-4a0a-8b86-63fba4a69bb3', '5d501ec8-6264-478e-9667-0a23c1dcac2d', '782e1424-4c3c-49fb-bf2b-f2a381eee60e', '6682c002-38d4-4f37-a186-43c5186885a5'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294382592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.manager [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:45:52 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Deleted volume successfully. Apr 14 01:45:52 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5d7b6c27-f2f3-4cb4-92c4-9507667b13ea tempest-VolumesAdminNegativeTest-1981219566 None] Lock "cinder-6b005472-0fd9-4c6f-928b-6f16bbb13ff1-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] create export for volume: f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] ensure volume f78596d7-c339-491a-a0d2-470a1c158a53 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] check if targe iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] create target and attach volume f78596d7-c339-491a-a0d2-470a1c158a53 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] create target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] atach volume v_f78596d7-c339-491a-a0d2-470a1c158a53 to target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:45:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6134336433353036', 'lun': 0, 'mode': 'wt', 'name': 'v_f78596d7-c339-491a-a0d2-470a1c158a53', 'prod_id': 'Storage', 'scsi_id': 'a43d3506631a64cd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] add credentails to target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Geting {'code': 201, 'error': None, 'data': {'name': 'eLIEctAV'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] initialize_connection for f78596d7-c339-491a-a0d2-470a1c158a53 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=36,cinder:SELECT=43,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '926cdbb1-12b5-4a56-ac64-b6d6ee0a829c'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:45:59 user cinder-volume[73579]: INFO cinder.volume.manager [req-3a955418-ace4-443d-a210-fcedb09b5fb5 req-c00bb591-068f-40d2-9833-cabf6fc2e8d6 tempest-TestShelveInstance-437254779 None] attachment_update completed successfully. Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Flow 'volume_create_manager' (f74768ef-9443-4e9a-8ec6-43a2931ca918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c992de-2694-43a3-964b-e35c23a1c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c992de-2694-43a3-964b-e35c23a1c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1738533660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=dccc3a21-0674-4347-842b-3d0354dfdfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:46:00Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d3b988-68e7-4f10-aa8e-cfba0619da7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d3b988-68e7-4f10-aa8e-cfba0619da7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443f5be8-0883-4afb-9cff-e31f38e6b83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443f5be8-0883-4afb-9cff-e31f38e6b83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dccc3a21-0674-4347-842b-3d0354dfdfa8', 'volume_name': 'volume-dccc3a21-0674-4347-842b-3d0354dfdfa8', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8558ae6-aa96-455d-b301-4105df805fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8558ae6-aa96-455d-b301-4105df805fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f019665d-25c1-4668-b6f0-6c10a46f3166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:00 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Volume dccc3a21-0674-4347-842b-3d0354dfdfa8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dccc3a21-0674-4347-842b-3d0354dfdfa8', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Cloning dccc3a21-0674-4347-842b-3d0354dfdfa8 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 46, 0, 429030)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 46, 0, 446412)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] create snapshot v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_dccc3a21-0674-4347-842b-3d0354dfdfa8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] create volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 from snapshot v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:46:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'is_clone': True, 'full_name': 'Pool-0/v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'name': 'v_dccc3a21-0674-4347-842b-3d0354dfdfa8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] get volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438171', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110589', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5554204853898868791', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '20d4758b60b045a4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294394880', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80755', 'name': 'v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Marking volume dccc3a21-0674-4347-842b-3d0354dfdfa8 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to dccc3a21-0674-4347-842b-3d0354dfdfa8. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Creating volume glance metadata for volume dccc3a21-0674-4347-842b-3d0354dfdfa8 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f019665d-25c1-4668-b6f0-6c10a46f3166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dccc3a21-0674-4347-842b-3d0354dfdfa8', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0cb8fe-0c34-4904-8825-84d1fa6f6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Volume volume-dccc3a21-0674-4347-842b-3d0354dfdfa8 (dccc3a21-0674-4347-842b-3d0354dfdfa8): created successfully Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0cb8fe-0c34-4904-8825-84d1fa6f6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Flow 'volume_create_manager' (f74768ef-9443-4e9a-8ec6-43a2931ca918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:02 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7d1bc562-c739-4061-9a04-07cf0a9cc60f tempest-TaggedBootDevicesTest_v242-819739955 None] Created volume successfully. Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Flow 'volume_create_manager' (f7bfec1c-e52e-4738-bcc2-14930e51dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8e70df-9ce9-48ac-a864-d3341f9a2d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8e70df-9ce9-48ac-a864-d3341f9a2d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1093534964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f01988fc-537f-4359-9b58-2a3f4752251b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:46:04Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83907ae5-6741-4e7b-9040-84c7b2b063f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83907ae5-6741-4e7b-9040-84c7b2b063f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32120586-d880-4be9-a597-d00b8845ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32120586-d880-4be9-a597-d00b8845ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01988fc-537f-4359-9b58-2a3f4752251b', 'volume_name': 'volume-f01988fc-537f-4359-9b58-2a3f4752251b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a02b085-861d-4a30-a49f-f43454193c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a02b085-861d-4a30-a49f-f43454193c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86cb359-e5b2-402e-b234-bf4a171596cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Volume f01988fc-537f-4359-9b58-2a3f4752251b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01988fc-537f-4359-9b58-2a3f4752251b', 'volume_size': 1} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] creating volume v_f01988fc-537f-4359-9b58-2a3f4752251b. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] create volume {'name': 'v_f01988fc-537f-4359-9b58-2a3f4752251b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f01988fc-537f-4359-9b58-2a3f4752251b', 'is_clone': False, 'name': 'v_f01988fc-537f-4359-9b58-2a3f4752251b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86cb359-e5b2-402e-b234-bf4a171596cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01988fc-537f-4359-9b58-2a3f4752251b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaad1bbc-8640-4214-ad69-853ba0a4f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:04 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Volume volume-f01988fc-537f-4359-9b58-2a3f4752251b (f01988fc-537f-4359-9b58-2a3f4752251b): created successfully Apr 14 01:46:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaad1bbc-8640-4214-ad69-853ba0a4f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Flow 'volume_create_manager' (f7bfec1c-e52e-4738-bcc2-14930e51dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7b501a16-32c6-48ea-8c82-25241cadfe33 tempest-TaggedBootDevicesTest_v242-819739955 None] Created volume successfully. Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Flow 'volume_create_manager' (b80cdd3d-1c57-45d5-85b4-3e7a9a37b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92bb74d-f75a-4642-81cf-2dd1591a5771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92bb74d-f75a-4642-81cf-2dd1591a5771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-598851587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ae6f77e9-ea6d-4653-9cd8-5944d88d743d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:46:05Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37d43a0-28cf-4d71-9ec7-ccee74fb0c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37d43a0-28cf-4d71-9ec7-ccee74fb0c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74115a97-9746-4564-908e-81733cbb8ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74115a97-9746-4564-908e-81733cbb8ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'volume_name': 'volume-ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a477a3-2026-4dbd-b9a7-5601d29c67c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a477a3-2026-4dbd-b9a7-5601d29c67c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a25f102-65f7-4f0e-9bf3-54c48e1624f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:05 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Volume ae6f77e9-ea6d-4653-9cd8-5944d88d743d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'volume_size': 1} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] creating volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] create volume {'name': 'v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'is_clone': False, 'name': 'v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a25f102-65f7-4f0e-9bf3-54c48e1624f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65ea709-dbab-4922-bd82-dee8b4d6c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:05 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Volume volume-ae6f77e9-ea6d-4653-9cd8-5944d88d743d (ae6f77e9-ea6d-4653-9cd8-5944d88d743d): created successfully Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65ea709-dbab-4922-bd82-dee8b4d6c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Flow 'volume_create_manager' (b80cdd3d-1c57-45d5-85b4-3e7a9a37b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-efe61749-1193-41aa-9880-125a3b657133 tempest-TaggedBootDevicesTest_v242-819739955 None] Created volume successfully. Apr 14 01:46:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=61,cinder:UPDATE=18,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Flow 'volume_create_manager' (a5cb0a0d-84a0-4182-b026-be0cb8a237f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b50942f-0e79-4c4a-bef8-35409f7618c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b50942f-0e79-4c4a-bef8-35409f7618c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1810074306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9186595-102b-4861-bf47-eda6b312e3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907f632263e04bf2a6c8ff1bae77a5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:46:16Z,use_quota=True,user_id='236828e284154097a25f59eaedf47c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1497fe1a-cdfa-4ea3-aa3c-74d3fc27d2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1497fe1a-cdfa-4ea3-aa3c-74d3fc27d2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd2bacf-6347-42f6-8f63-bdf1ef2e8e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd2bacf-6347-42f6-8f63-bdf1ef2e8e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9186595-102b-4861-bf47-eda6b312e3a6', 'volume_name': 'volume-f9186595-102b-4861-bf47-eda6b312e3a6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df011f64-23a6-4b8e-8b7e-b76fe145a861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df011f64-23a6-4b8e-8b7e-b76fe145a861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28142ceb-8f5c-48ff-acf5-b0806beb8c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:16 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Volume f9186595-102b-4861-bf47-eda6b312e3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9186595-102b-4861-bf47-eda6b312e3a6', 'volume_size': 1} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] creating volume v_f9186595-102b-4861-bf47-eda6b312e3a6. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] create volume {'name': 'v_f9186595-102b-4861-bf47-eda6b312e3a6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f9186595-102b-4861-bf47-eda6b312e3a6', 'is_clone': False, 'name': 'v_f9186595-102b-4861-bf47-eda6b312e3a6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28142ceb-8f5c-48ff-acf5-b0806beb8c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9186595-102b-4861-bf47-eda6b312e3a6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a511a7-3de3-4c0f-9202-9eb1887497a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:46:17 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Volume volume-f9186595-102b-4861-bf47-eda6b312e3a6 (f9186595-102b-4861-bf47-eda6b312e3a6): created successfully Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a511a7-3de3-4c0f-9202-9eb1887497a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Flow 'volume_create_manager' (a5cb0a0d-84a0-4182-b026-be0cb8a237f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:46:17 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fca5bd64-deee-4fb2-99d8-40771a880adb tempest-ServersNegativeTestJSON-1259366012 None] Created volume successfully. Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] create export for volume: dccc3a21-0674-4347-842b-3d0354dfdfa8. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] ensure volume dccc3a21-0674-4347-842b-3d0354dfdfa8 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] check if targe iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] create target and attach volume dccc3a21-0674-4347-842b-3d0354dfdfa8 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] create target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] atach volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 to target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:46:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3230643437353862', 'lun': 0, 'mode': 'wt', 'name': 'v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'prod_id': 'Storage', 'scsi_id': '20d4758b60b045a4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] add credentails to target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'name': 'pnIKHyQa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] initialize_connection for dccc3a21-0674-4347-842b-3d0354dfdfa8 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIKHyQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '39b50bc8-687b-4ade-ba07-779569acf68f'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:46:21 user cinder-volume[73579]: INFO cinder.volume.manager [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-0dfb911e-4079-48ee-88e9-1c951cc98d33 tempest-TaggedBootDevicesTest_v242-819739955 None] attachment_update completed successfully. Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] create export for volume: f01988fc-537f-4359-9b58-2a3f4752251b. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] ensure volume f01988fc-537f-4359-9b58-2a3f4752251b assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] check if targe iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] create target and attach volume f01988fc-537f-4359-9b58-2a3f4752251b to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] create target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] atach volume v_f01988fc-537f-4359-9b58-2a3f4752251b to target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:46:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6331656236343039', 'lun': 0, 'mode': 'wt', 'name': 'v_f01988fc-537f-4359-9b58-2a3f4752251b', 'prod_id': 'Storage', 'scsi_id': 'c1eb640991852245'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] add credentails to target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f6395031-2faf-4181-8be5-8f02d3e64acc tempest-VolumesActionsTest-193871514 None] Acquiring lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" by "attach_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f6395031-2faf-4181-8be5-8f02d3e64acc tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" acquired by "attach_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'name': 'lUEoPgwk'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] initialize_connection for f01988fc-537f-4359-9b58-2a3f4752251b 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:46:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f6395031-2faf-4181-8be5-8f02d3e64acc tempest-VolumesActionsTest-193871514 None] Attaching volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f to instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb at mountpoint /dev/vdb on host None. Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUEoPgwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '28e490a1-0ef3-4608-89a5-7f290c91b23b'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:46:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f6395031-2faf-4181-8be5-8f02d3e64acc tempest-VolumesActionsTest-193871514 None] Attach volume completed successfully. Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f6395031-2faf-4181-8be5-8f02d3e64acc tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" released by "attach_volume" :: held 0.076s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:46:26 user cinder-volume[73579]: INFO cinder.volume.manager [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-88dfcbd8-809e-477b-8702-7996c36d0e96 tempest-TaggedBootDevicesTest_v242-819739955 None] attachment_update completed successfully. Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Acquiring lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-detach_volume" by "detach_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:46:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Detaching volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f from instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb. Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] remove_export for volume: 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030025018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f,launched_at=2023-04-14T01:41:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb176ac656c47b38e736fc629fc46e0',provider_auth='CHAP NHSYgVvB zt0HpaTsvmVBJD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:48Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:46:26Z,use_quota=True,user_id='8b18b911fcf847efbf4f814f3b687279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] detach volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f from target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] failed to remove resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f because of JDSS resource v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] delete target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] delete target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] failed to remove resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f because of JDSS resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=70,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Detach volume completed successfully. Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9e5c4c08-7c12-4dea-8ced-7a3a25b77107 tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] create export for volume: ae6f77e9-ea6d-4653-9cd8-5944d88d743d. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] ensure volume ae6f77e9-ea6d-4653-9cd8-5944d88d743d assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] check if targe iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] create target and attach volume ae6f77e9-ea6d-4653-9cd8-5944d88d743d to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] create target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] terminate connection for 4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:46:29 user cinder-volume[73579]: INFO cinder.volume.manager [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Terminate volume connection completed successfully. Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Deleting attachment abb9a434-5221-494f-8d94-29fc7a6941ab. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: 4ab38ffd-6daf-4153-b3eb-8817849e499d. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4ab38ffd-6daf-4153-b3eb-8817849e499d,launched_at=2023-04-14T01:44:41Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP LsEAhbUg NrEdwiySxjFGzc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:38Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=9407ec8e-7fa7-49e3-81a0-e6659fd98f5d,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:44:50Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] detach volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d from target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] atach volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d to target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-b06b2f48-e9bb-42be-be93-601aa93a12f5 tempest-TestVolumeBootPattern-224521177 None] target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.coordination [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-4ab38ffd-6daf-4153-b3eb-8817849e499d-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.coordination [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-4ab38ffd-6daf-4153-b3eb-8817849e499d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: 4ab38ffd-6daf-4153-b3eb-8817849e499d. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4ab38ffd-6daf-4153-b3eb-8817849e499d,launched_at=2023-04-14T01:44:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP LsEAhbUg NrEdwiySxjFGzc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:38Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=9407ec8e-7fa7-49e3-81a0-e6659fd98f5d,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:46:30Z,updated_at=2023-04-14T01:46:30Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] detach volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d from target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns/v_4ab38ffd-6daf-4153-b3eb-8817849e499d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d/luns/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d because of JDSS resource v_4ab38ffd-6daf-4153-b3eb-8817849e499d DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d because of JDSS resource iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] deleating volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] get volume v_4ab38ffd-6daf-4153-b3eb-8817849e499d info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d@v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438088', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '110503', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12053510212643435953', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': '8755e0a3c59290ab', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294104064', 'san:volume_id': '8755e0a3c59290ab5345a5b6fd2ef2cf1db87fc0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '82560', 'name': 'v_4ab38ffd-6daf-4153-b3eb-8817849e499d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] delete snapshot v_4ab38ffd-6daf-4153-b3eb-8817849e499d of volume s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3530663837633466', 'lun': 0, 'mode': 'wt', 'name': 'v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'prod_id': 'Storage', 'scsi_id': '50f87c4f5d43163a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] add credentails to target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 201, 'error': None, 'data': {'name': 'wdltqivh'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] initialize_connection for ae6f77e9-ea6d-4653-9cd8-5944d88d743d 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdltqivh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4cee129c-6fa5-4659-99e5-1312f60e47ad'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:46:31 user cinder-volume[73579]: INFO cinder.volume.manager [req-2415ed54-4fb1-4e4e-964c-466241b546ca req-2621ae2a-a863-426a-8df6-79e2b1b5de22 tempest-TaggedBootDevicesTest_v242-819739955 None] attachment_update completed successfully. Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114294104064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:46:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:46:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots/v_4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] snapshot v_4ab38ffd-6daf-4153-b3eb-8817849e499d deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:46:32 user cinder-volume[73579]: DEBUG cinder.quota [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Created reservations ['1f49626e-74c2-46b8-9ea1-284997c0684a', 'f83f78bb-79c6-41b1-b9c4-6cbc925c4770', 'dfa02b07-84eb-46f8-9da7-482964f3c441', '9a82f62c-876b-48e6-b51e-e937e720b279'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:46:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:46:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:46:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304270336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:46:33 user cinder-volume[73579]: DEBUG cinder.manager [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:46:33 user cinder-volume[73579]: INFO cinder.volume.manager [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Deleted volume successfully. Apr 14 01:46:33 user cinder-volume[73579]: DEBUG cinder.coordination [req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 req-3db5a5ed-a09c-44eb-ba61-7845f54847ed tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-4ab38ffd-6daf-4153-b3eb-8817849e499d-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Acquiring lock "cinder-e51f02c1-71b8-4c63-9bae-d2210e2363dc-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Lock "cinder-e51f02c1-71b8-4c63-9bae-d2210e2363dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] remove_export for volume: e51f02c1-71b8-4c63-9bae-d2210e2363dc. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-787066069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e51f02c1-71b8-4c63-9bae-d2210e2363dc,launched_at=2023-04-14T01:42:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a409270d6d4d408de33c5e71a56da9',provider_auth='CHAP THiIXmcP RPpnwm24zZIa9S',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:55Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:46:43Z,updated_at=2023-04-14T01:46:43Z,use_quota=True,user_id='bbaf843e44ff4359a15ab6d625134b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] detach volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc from target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc/luns/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] failed to remove resource iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc because of JDSS resource v_e51f02c1-71b8-4c63-9bae-d2210e2363dc DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] delete target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] delete target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] failed to remove resource iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc because of JDSS resource iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] deleating volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] get snapshots for volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] get volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437985', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110388', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1482437205568617237', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eca478ffba74f6cb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304282624', 'san:volume_id': 'eca478ffba74f6cba755a48571d621ef2a15d790', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81772', 'name': 'v_e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] delete volume:v_e51f02c1-71b8-4c63-9bae-d2210e2363dc recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e51f02c1-71b8-4c63-9bae-d2210e2363dc {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] volume v_e51f02c1-71b8-4c63-9bae-d2210e2363dc deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:46:45 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=79,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.quota [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Created reservations ['05637577-975f-4ed5-9324-83ced768dd9c', '1ed90ca1-bae0-4950-9d35-c7bb96eec393', '0105c151-f8bc-4217-b025-5d3318f2cf50', '6dcaf36f-707f-45e2-9687-cd388361615b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304364544', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.manager [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:46:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Deleted volume successfully. Apr 14 01:46:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b93bb5ba-6bba-4c20-874c-946f3bd6df96 tempest-VolumesAdminNegativeTest-1981219566 None] Lock "cinder-e51f02c1-71b8-4c63-9bae-d2210e2363dc-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:47:05 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=40,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:05 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] terminate connection for 7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:47:10 user cinder-volume[73579]: INFO cinder.volume.manager [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Terminate volume connection completed successfully. Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Deleting attachment cca51a1e-a7f1-4078-bada-b708a9819bf2. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] remove_export for volume: 7298e05a-b142-4365-95e1-f8551de0ae79. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-94214556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7298e05a-b142-4365-95e1-f8551de0ae79,launched_at=2023-04-14T01:44:36Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4833ddea1fa74866b97ef52a730605aa',provider_auth='CHAP nmkLiNCj pQf0gyvu168tOR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:35Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:47:09Z,use_quota=True,user_id='f09ab986a00f43b384cf5d517857a13d',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] detach volume v_7298e05a-b142-4365-95e1-f8551de0ae79 from target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] delete target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] delete target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c484f095-d3f3-476e-a826-ee8a2148e8c5 req-6cdc5688-b4f3-4bf1-aca5-22bb8d889a4b tempest-ServerStableDeviceRescueTest-131403183 None] target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-9407ec8e-7fa7-49e3-81a0-e6659fd98f5d-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-9407ec8e-7fa7-49e3-81a0-e6659fd98f5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] deleating snapshot s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] get volume s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5@s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438081', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110490', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3010806352307773708', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '626eeafac201e881', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294198272', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82441', 'name': 's_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] delete snapshot s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d of volume v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] copy_volume_to_image volume-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) copy_volume_to_image /opt/stack/cinder/cinder/volume/driver.py:930}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG os_brick.utils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f497e4-6a37-447b-b9a0-19b6cf865ef6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de90af-b7d1-4467-b792-e0a790abff08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c7035f-e40f-456b-82bc-83329dd9b669]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4b440a-c860-4e57-9625-5e72a0479915]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Running cmd (subprocess): nvme version {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] 'nvme version' failed. Not Retrying. {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] nvme not present on system {{(pid=73579) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 01:47:18 user cinder-volume[73579]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 01:47:18 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[8573fe06-0e27-4517-81e3-2e7dc5b7dfa9]: (4, '') {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73579) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73579) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] LIGHTOS: no hostnqn found. {{(pid=73579) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG os_brick.utils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f: creating export {{(pid=73579) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] create export for volume: 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] ensure volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] check if targe iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] create target and attach volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] create target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots/s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] snapshot s_9407ec8e-7fa7-49e3-81a0-e6659fd98f5d deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.quota [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Created reservations ['d69d33e3-c008-4ace-84cf-edd105a08d33', '00ab4fce-78bc-42cd-befb-53aee7b9a849', 'd37062c6-7ef0-4923-9348-5bd4845433f6', '399e9fce-2efd-4f92-b2a8-f1d01968f4c0'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:47:19 user cinder-volume[73579]: INFO cinder.volume.manager [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Delete snapshot completed successfully. Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-27d42254-143a-441f-b09f-b4b91fd182ed tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-9407ec8e-7fa7-49e3-81a0-e6659fd98f5d-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-9ec4ec10-1905-471c-90ef-6a4fdac9a0e5-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-9ec4ec10-1905-471c-90ef-6a4fdac9a0e5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: 9ec4ec10-1905-471c-90ef-6a4fdac9a0e5. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-229139402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9ec4ec10-1905-471c-90ef-6a4fdac9a0e5,launched_at=2023-04-14T01:44:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP lKVXcFhO ubaFOx9ERJqym2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:28Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:47:19Z,updated_at=2023-04-14T01:47:19Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] detach volume v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 from target iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/luns/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/luns/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/luns/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/luns/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 because of JDSS resource v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 because of JDSS resource iqn.2010-10.org.openstack:9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] deleating volume v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] get volume v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438078', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110477', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10440273845844845776', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cca6d43863d7b5d3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294235136', 'san:volume_id': 'cca6d43863d7b5d3388842c187396e53aa67a3ab', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81001', 'name': 'v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] delete snapshot v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] snapshot v_9ec4ec10-1905-471c-90ef-6a4fdac9a0e5 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.quota [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Created reservations ['7c2210e9-8504-4f92-8f88-d3b64455a0a7', 'a2b86853-bbac-4aa5-8511-e49045d2559c', '65bb0e00-83af-4170-bcb5-5cf5fb1284a7', '055a936a-81c0-498d-8ef3-c1a743169afa'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] atach volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f to target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (f3b1e9df-9607-456c-bf12-3e9ae7a80192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae02df71-0a87-4b6b-8613-2b632b929d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294259712', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.manager [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae02df71-0a87-4b6b-8613-2b632b929d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1317814532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9cb54ed-9520-43e9-a1c8-2be10b7f955e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:47:22Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a44f91-8ef1-467c-acd0-a7c83f1b289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a44f91-8ef1-467c-acd0-a7c83f1b289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f29bea1-2122-4f28-84e3-6f3c7052cca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Deleted volume successfully. Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c14e8a86-177e-4f47-ad1a-4e8fadd0df71 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-9ec4ec10-1905-471c-90ef-6a4fdac9a0e5-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f29bea1-2122-4f28-84e3-6f3c7052cca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'volume_name': 'volume-f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60240123-0820-43b0-ad63-97f52d5e5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60240123-0820-43b0-ad63-97f52d5e5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b7a412-7243-422e-b4fe-43a905befb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:22 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Cloning f9cb54ed-9520-43e9-a1c8-2be10b7f955e from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 47, 22, 330081)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 47, 22, 344544)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] create snapshot v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3730616338343037', 'lun': 0, 'mode': 'wt', 'name': 'v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'prod_id': 'Storage', 'scsi_id': '70ac84076660749c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] add credentails to target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Geting {'code': 201, 'error': None, 'data': {'name': 'NHSYgVvB'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] initialize_connection for 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG os_brick.initiator.connector [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Factory for iscsi on None {{(pid=73579) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSYgVvB', 'auth_password': '***', 'target_lun': False}}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 01:47:22 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 01:47:22 user cinder-volume[73579]: INFO os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedbf9ff-27c8-4d8a-b4b6-690c7213aa3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 01:47:23 user cinder-volume[73579]: {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --interface default --op new {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[5338fe72-eeee-430a-bd6a-f84a264b1460]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f] added\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f] added Apr 14 01:47:23 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2270e0-43a0-4299-a692-32da2ee2482a]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd914fc5-0b84-40c8-b60b-c14728952a49]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHSYgVvB {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHSYgVvB" returned: 0 in 0.024s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df47fe6-c884-45eb-8920-928ad9731d5f]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHSYgVvB'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5998ccb-e662-40fe-948c-2ec826f3314c]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40eb5e3-b611-4b61-865f-2098f4a1fdb1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --login {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba00b037-6cab-4b73-8408-70faa49d3845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260] Apr 14 01:47:23 user cinder-volume[73579]: Login to [iface: default, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260] successful. Apr 14 01:47:23 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[328b76a5-0289-4fcb-8bab-1ba443f68b2f]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8e510-473b-4adc-8472-d339d1279b3f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash) Apr 14 01:47:23 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Connected to 172.16.0.220:3260 {{(pid=73579) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73579) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Scanning host 34 c: -, t: -, l: 0) {{(pid=73579) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a404c-ccf9-4fda-9663-78f493c0ef96]: (4, ('- - 0', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73579) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSYgVvB', 'auth_password': '***', 'target_lun': False} {{(pid=73579) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] create volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e from snapshot v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'is_clone': True, 'full_name': 'Pool-0/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'name': 'v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] get volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438252', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '110647', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14229966085916253964', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3b64ae281c6fdf4c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294247424', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82476', 'name': 'v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Marking volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to f9cb54ed-9520-43e9-a1c8-2be10b7f955e. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Creating volume glance metadata for volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b7a412-7243-422e-b4fe-43a905befb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac68d9b1-0791-4dae-b42b-0dffd37e554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Volume volume-f9cb54ed-9520-43e9-a1c8-2be10b7f955e (f9cb54ed-9520-43e9-a1c8-2be10b7f955e): created successfully Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac68d9b1-0791-4dae-b42b-0dffd37e554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (f3b1e9df-9607-456c-bf12-3e9ae7a80192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1f762b77-d8c7-43e2-95cd-a3d2963a0d48 tempest-TestVolumeBootPattern-224521177 None] Created volume successfully. Apr 14 01:47:24 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23730616338343037', 'path': '/dev/sdc'} {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdc of=/dev/null count=1 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdc of=/dev/null count=1" returned: 0 in 0.015s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc0631-2ce7-437a-b509-fbfceff7f771]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00210496 s, 243 kB/s\n')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] 3209642e-ae96-43f5-972c-a528749494d6 was raw, no need to convert to raw {{(pid=73579) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1004}} Apr 14 01:47:24 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdc {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:24 user sudo[88163]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdc Apr 14 01:47:24 user sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:47:25 user sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 14 01:47:25 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdc" returned: 0 in 0.741s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] create export for volume: f9cb54ed-9520-43e9-a1c8-2be10b7f955e. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] ensure volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] check if targe iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] create target and attach volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] create target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] atach volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e to target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114294222848', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:47:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:47:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3362363461653238', 'lun': 0, 'mode': 'wt', 'name': 'v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'prod_id': 'Storage', 'scsi_id': '3b64ae281c6fdf4c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] add credentails to target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:47:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'name': 'sxmOykTu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] initialize_connection for f9cb54ed-9520-43e9-a1c8-2be10b7f955e 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:47:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxmOykTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '8027938d-3ad1-4401-b369-fc538dd26498'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:47:33 user cinder-volume[73579]: INFO cinder.volume.manager [req-5d209768-0db8-4c62-a616-71e512c84f75 req-60df2953-2279-4cfa-b965-1774c893545e tempest-TestVolumeBootPattern-224521177 None] attachment_update completed successfully. Apr 14 01:47:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:UPDATE=19,cinder:INSERT=12 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=59,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (4a5637ad-159e-4977-b748-14e8b5d1fcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f28f2b9-d08e-489e-a83f-1e1f99c8a7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f28f2b9-d08e-489e-a83f-1e1f99c8a7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-356055281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64fbddc5-4def-42b8-8084-284892fa8b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:47:37Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed5169a-c492-4019-8d05-dbc9a955f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed5169a-c492-4019-8d05-dbc9a955f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400592cf-0e10-41e4-9a27-c5369c91e9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400592cf-0e10-41e4-9a27-c5369c91e9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64fbddc5-4def-42b8-8084-284892fa8b62', 'volume_name': 'volume-64fbddc5-4def-42b8-8084-284892fa8b62', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07744ae-7862-4810-9fbe-2f6eb82ac290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07744ae-7862-4810-9fbe-2f6eb82ac290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e48d87-b426-4bcd-a78a-558f01a83e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:37 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Volume 64fbddc5-4def-42b8-8084-284892fa8b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64fbddc5-4def-42b8-8084-284892fa8b62', 'volume_size': 1} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] creating volume v_64fbddc5-4def-42b8-8084-284892fa8b62. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] create volume {'name': 'v_64fbddc5-4def-42b8-8084-284892fa8b62', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62', 'is_clone': False, 'name': 'v_64fbddc5-4def-42b8-8084-284892fa8b62'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e48d87-b426-4bcd-a78a-558f01a83e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fbddc5-4def-42b8-8084-284892fa8b62', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a9931b-9369-456b-994f-2c06d30743c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:38 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Volume volume-64fbddc5-4def-42b8-8084-284892fa8b62 (64fbddc5-4def-42b8-8084-284892fa8b62): created successfully Apr 14 01:47:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a9931b-9369-456b-994f-2c06d30743c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (4a5637ad-159e-4977-b748-14e8b5d1fcfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:38 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e8f23197-69fd-4b66-b4c6-45845455319d tempest-SnapshotDataIntegrityTests-919714320 None] Created volume successfully. Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] create export for volume: 64fbddc5-4def-42b8-8084-284892fa8b62. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] ensure volume 64fbddc5-4def-42b8-8084-284892fa8b62 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] check if targe iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] create target and attach volume 64fbddc5-4def-42b8-8084-284892fa8b62 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] create target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:44 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:44 user sudo[88495]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Apr 14 01:47:44 user sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 01:47:45 user sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.920s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSYgVvB', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23730616338343037', 'path': '/dev/sdc'}), 'kwargs': {'force': True}}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2544710-b31c-4ae4-a1bc-64fe1ff8e86b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 01:47:45 user cinder-volume[73579]: No targets found. Apr 14 01:47:45 user cinder-volume[73579]: iSNS: Apr 14 01:47:45 user cinder-volume[73579]: No targets found. Apr 14 01:47:45 user cinder-volume[73579]: STATIC: Apr 14 01:47:45 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 Apr 14 01:47:45 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:47:45 user cinder-volume[73579]: Iface Name: default Apr 14 01:47:45 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 Apr 14 01:47:45 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:47:45 user cinder-volume[73579]: Iface Name: default Apr 14 01:47:45 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d Apr 14 01:47:45 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:47:45 user cinder-volume[73579]: Iface Name: default Apr 14 01:47:45 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b Apr 14 01:47:45 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:47:45 user cinder-volume[73579]: Iface Name: default Apr 14 01:47:45 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e Apr 14 01:47:45 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:47:45 user cinder-volume[73579]: Iface Name: default Apr 14 01:47:45 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f Apr 14 01:47:45 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:47:45 user cinder-volume[73579]: Iface Name: default Apr 14 01:47:45 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 Apr 14 01:47:45 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 01:47:45 user cinder-volume[73579]: Iface Name: default Apr 14 01:47:45 user cinder-volume[73579]: FIRMWARE: Apr 14 01:47:45 user cinder-volume[73579]: No targets found. Apr 14 01:47:45 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 01:47:45 user cinder-volume[73579]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 01:47:45 user cinder-volume[73579]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73579) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 0)] {{(pid=73579) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb19db3-86ef-42bb-ad9c-2cfa697df3a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ad153-df31-4047-b0db-e1fdabc3db87]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash) Apr 14 01:47:45 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Resulting device map defaultdict(. at 0x7f9f6ef3c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'): ({'sdc'}, set())}) {{(pid=73579) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Removing single pathed devices sdc {{(pid=73579) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a07c26-f599-4e98-951c-0a8468874927]: (4, ('path checker states:\nup 7\n\npaths: 0\nbusy: False\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[6942a8fc-eca9-4f12-ac17-8a0f130bafba]: (4, ('ok\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Flushing IO for device /dev/sdc {{(pid=73579) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca316f-3ebe-422b-9b0c-648dc20d9395]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73579) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc1cf8-2cab-45cf-9e98-46aef2946429]: (4, ('1', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=73579) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] SCSI volumes sdc have been removed. {{(pid=73579) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f')] {{(pid=73579) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfc6b6-47d1-46c3-94f6-a539e8887994]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --logout {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6923a3-c985-4b74-9b22-35d3c5f72647]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260] Apr 14 01:47:45 user cinder-volume[73579]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f, portal: 172.16.0.220,3260] successful. Apr 14 01:47:45 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op delete {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[76650638-f3e8-4dba-90a4-bfcb2e009f3b]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] <== disconnect_volume: return (435ms) None {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] terminate connection for 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] volume 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f: removing export {{(pid=73579) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] remove_export for volume: 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030025018',ec2_id=None,encryption_key_id=None,glance_metadata={},group=,group_id=None,host='user@joviandss-2#joviandss-2',id=867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f,launched_at=2023-04-14T01:41:49Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='cdb176ac656c47b38e736fc629fc46e0',provider_auth='CHAP NHSYgVvB zt0HpaTsvmVBJD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:48Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='uploading',terminated_at=None,updated_at=2023-04-14T01:47:18Z,use_quota=True,user_id='8b18b911fcf847efbf4f814f3b687279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] detach volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f from target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] atach volume v_64fbddc5-4def-42b8-8084-284892fa8b62 to target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] delete target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] delete target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:47:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Uploaded volume to glance image-id: 3209642e-ae96-43f5-972c-a528749494d6. {{(pid=73579) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1793}} Apr 14 01:47:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a3b63d60-d42a-4c1a-9185-782493549721 tempest-VolumesActionsTest-193871514 None] Copy volume to image completed successfully. Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6162623361316436', 'lun': 0, 'mode': 'wt', 'name': 'v_64fbddc5-4def-42b8-8084-284892fa8b62', 'prod_id': 'Storage', 'scsi_id': 'abb3a1d6daa61742'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] add credentails to target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] terminate connection for f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:47:47 user cinder-volume[73579]: INFO cinder.volume.manager [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Terminate volume connection completed successfully. Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Deleting attachment 926cdbb1-12b5-4a56-ac64-b6d6ee0a829c. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] remove_export for volume: f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1954746558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f78596d7-c339-491a-a0d2-470a1c158a53,launched_at=2023-04-14T01:42:08Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',provider_auth='CHAP eLIEctAV AF2jgh5YQbo6vk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:05Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:46:00Z,use_quota=True,user_id='447da297b18f4e7f86fa94cd4d5d7918',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] detach volume v_f78596d7-c339-491a-a0d2-470a1c158a53 from target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'name': 'csJKGTSq'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] initialize_connection for 64fbddc5-4def-42b8-8084-284892fa8b62 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csJKGTSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'eb686bb5-ca2f-4c57-91c1-aed639bae3bb'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.coordination [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Acquiring lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.coordination [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:47:47 user cinder-volume[73579]: INFO cinder.volume.manager [req-420b21b6-15d4-404d-a8cd-c5fe966d510f req-2b827647-fff4-471f-a88b-400133955dae tempest-SnapshotDataIntegrityTests-919714320 None] attachment_update completed successfully. Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] remove_export for volume: 867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030025018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f,launched_at=2023-04-14T01:41:49Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='cdb176ac656c47b38e736fc629fc46e0',provider_auth='CHAP NHSYgVvB zt0HpaTsvmVBJD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:41:48Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:47:47Z,updated_at=2023-04-14T01:47:47Z,use_quota=True,user_id='8b18b911fcf847efbf4f814f3b687279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] detach volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f from target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/luns/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] failed to remove resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f because of JDSS resource v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] delete target: iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] delete target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] failed to remove resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f because of JDSS resource iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] deleating volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] get snapshots for volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] delete target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] delete target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-6f077fcf-5d01-4715-be29-c59d0b546154 tempest-TestShelveInstance-437254779 None] target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] get volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437918', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110313', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1964944091570260235', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '70ac84076660749c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294116352', 'san:volume_id': '70ac84076660749c9c09d828c2575d8c0db78ed0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81334', 'name': 'v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] delete volume:v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.coordination [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Acquiring lock "cinder-f78596d7-c339-491a-a0d2-470a1c158a53-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.coordination [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Lock "cinder-f78596d7-c339-491a-a0d2-470a1c158a53-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] remove_export for volume: f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1954746558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f78596d7-c339-491a-a0d2-470a1c158a53,launched_at=2023-04-14T01:42:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',provider_auth='CHAP eLIEctAV AF2jgh5YQbo6vk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:42:05Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:47:48Z,updated_at=2023-04-14T01:47:48Z,use_quota=True,user_id='447da297b18f4e7f86fa94cd4d5d7918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] detach volume v_f78596d7-c339-491a-a0d2-470a1c158a53 from target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53/luns/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] failed to remove resource iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 because of JDSS resource v_f78596d7-c339-491a-a0d2-470a1c158a53 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] delete target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] delete target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] failed to remove resource iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 because of JDSS resource iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] deleating volume v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] get snapshots for volume v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] get volume v_f78596d7-c339-491a-a0d2-470a1c158a53 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_f78596d7-c339-491a-a0d2-470a1c158a53', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f78596d7-c339-491a-a0d2-470a1c158a53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681437936', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26120192', 'sharesmb': None, 'createtxg': '110355', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12290458028519640957', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10141696', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': 'a43d3506631a64cd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294116352', 'san:volume_id': 'a43d3506631a64cdb97d549912368188e3e5c86c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10141696', 'objsetid': '82053', 'name': 'v_f78596d7-c339-491a-a0d2-470a1c158a53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10141696', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] delete snapshot v_f78596d7-c339-491a-a0d2-470a1c158a53 of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Flow 'volume_create_manager' (1f266c7f-38ea-4fc2-a56c-d48d631afa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889be7dd-2228-4a02-b3d0-138d683acaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889be7dd-2228-4a02-b3d0-138d683acaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-636637609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=03b1d79c-7368-42b7-a7d9-ec20888c0103,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94252b8938d44d0eaeabca79d6dca0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:47:49Z,use_quota=True,user_id='bb2025c1b16945ebb98b0cc645d88877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dc2873-37e4-42bb-a367-a028c6c7127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dc2873-37e4-42bb-a367-a028c6c7127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a735bc-438a-49ae-82de-8dbaed3fa97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a735bc-438a-49ae-82de-8dbaed3fa97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b1d79c-7368-42b7-a7d9-ec20888c0103', 'volume_name': 'volume-03b1d79c-7368-42b7-a7d9-ec20888c0103', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa9b05e-5ef7-4916-964e-ff46b2fe38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa9b05e-5ef7-4916-964e-ff46b2fe38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4ada4c-36fe-4a33-b98a-d882389c355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:49 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b1d79c-7368-42b7-a7d9-ec20888c0103', 'volume_size': 1} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] creating volume v_03b1d79c-7368-42b7-a7d9-ec20888c0103. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] create volume {'name': 'v_03b1d79c-7368-42b7-a7d9-ec20888c0103', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] volume v_867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.quota [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Created reservations ['f8848b23-35b0-4240-a067-830d94c422ae', 'b8724631-898a-48f2-bde6-135633dd1968', 'fe9b76eb-b428-4074-b70c-1c8f84625e5a', '8776105a-00a8-4528-b730-e35db5c0e3d6'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_03b1d79c-7368-42b7-a7d9-ec20888c0103', 'is_clone': False, 'name': 'v_03b1d79c-7368-42b7-a7d9-ec20888c0103'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4ada4c-36fe-4a33-b98a-d882389c355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b1d79c-7368-42b7-a7d9-ec20888c0103', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdc4b3c-f0f2-401a-b72e-6cfa0e1d15f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:50 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Volume volume-03b1d79c-7368-42b7-a7d9-ec20888c0103 (03b1d79c-7368-42b7-a7d9-ec20888c0103): created successfully Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdc4b3c-f0f2-401a-b72e-6cfa0e1d15f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Flow 'volume_create_manager' (1f266c7f-38ea-4fc2-a56c-d48d631afa25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:50 user cinder-volume[73579]: INFO cinder.volume.manager [req-c5b2d247-f867-4947-87ab-16d25fc22a64 req-29a9744d-d594-4621-b754-94cee0a63f39 tempest-VolumesGetTestJSON-1546803663 None] Created volume successfully. Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] snapshot v_f78596d7-c339-491a-a0d2-470a1c158a53 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.quota [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Created reservations ['97d8270a-552a-4aa5-98ae-dafc978fa1ec', '2a37e3f6-c3b4-4d9d-99e8-653459d6ac94', '19a5bdc5-3e83-457d-a6de-efb062e4ed83', 'c5e2cc56-f261-40da-9a7c-35b59eb6b34b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294222848', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.manager [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:47:50 user cinder-volume[73579]: INFO cinder.volume.manager [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Deleted volume successfully. Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.coordination [req-068fb27f-0739-41e3-9df3-4d00630526dd req-9e60d93d-3a9a-472f-9227-110957266237 tempest-TestShelveInstance-437254779 None] Lock "cinder-f78596d7-c339-491a-a0d2-470a1c158a53-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304368640', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.manager [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:47:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Deleted volume successfully. Apr 14 01:47:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-de921a16-b28d-4f49-b190-6ec083f56675 tempest-VolumesActionsTest-193871514 None] Lock "cinder-867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot c240a035-a4c9-4b0f-9e37-04d8aea59cb8 for volume 64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] cloning v_64fbddc5-4def-42b8-8084-284892fa8b62 to s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.coordination [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Acquiring lock "cinder-03b1d79c-7368-42b7-a7d9-ec20888c0103-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.coordination [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Lock "cinder-03b1d79c-7368-42b7-a7d9-ec20888c0103-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] remove_export for volume: 03b1d79c-7368-42b7-a7d9-ec20888c0103. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-636637609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=03b1d79c-7368-42b7-a7d9-ec20888c0103,launched_at=2023-04-14T01:47:51Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94252b8938d44d0eaeabca79d6dca0cd',provider_auth='CHAP QavXPUkx Bc19YlUWgyJAaI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:49Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:47:52Z,updated_at=2023-04-14T01:47:52Z,use_quota=True,user_id='bb2025c1b16945ebb98b0cc645d88877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] detach volume v_03b1d79c-7368-42b7-a7d9-ec20888c0103 from target iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103/luns/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103/luns/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103/luns/v_03b1d79c-7368-42b7-a7d9-ec20888c0103'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103/luns/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] failed to remove resource iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 because of JDSS resource v_03b1d79c-7368-42b7-a7d9-ec20888c0103 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] delete target: iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] delete target iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] failed to remove resource iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 because of JDSS resource iqn.2010-10.org.openstack:03b1d79c-7368-42b7-a7d9-ec20888c0103 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] deleating volume v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] get snapshots for volume v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c240a035-a4c9-4b0f-9e37-04d8aea59cb8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] create volume s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 from snapshot s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] get volume v_03b1d79c-7368-42b7-a7d9-ec20888c0103 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_03b1d79c-7368-42b7-a7d9-ec20888c0103', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438279', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110671', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7858000052298300966', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2c1337993a9caa36', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114294218752', 'san:volume_id': '2c1337993a9caa36ed9c77489b51576554fdc015', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82492', 'name': 'v_03b1d79c-7368-42b7-a7d9-ec20888c0103', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] delete volume:v_03b1d79c-7368-42b7-a7d9-ec20888c0103 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62@s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8', 'is_clone': True, 'full_name': 'Pool-0/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8', 'name': 's_c240a035-a4c9-4b0f-9e37-04d8aea59cb8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] volume s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:47:53 user cinder-volume[73579]: INFO cinder.volume.manager [None req-62bea964-4ad0-4c41-9b73-6053798a5956 tempest-SnapshotDataIntegrityTests-919714320 None] Create snapshot completed successfully Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Flow 'volume_create_manager' (6e44c095-57e0-4067-a624-f9980a7cd2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72a4690-6202-476a-b21b-65a6b6f2fbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72a4690-6202-476a-b21b-65a6b6f2fbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1493946080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2a0bcee1-da2a-4ad3-84a6-e04a36276c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca7c280d61047f4a679e9d31c687d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:47:54Z,use_quota=True,user_id='5a9059be430640e9bb9744bd6ef9d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50db1155-c644-4ceb-8ebc-cae8983b10ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50db1155-c644-4ceb-8ebc-cae8983b10ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9c8b3a-775a-49f1-8e2e-4d7242d50c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9c8b3a-775a-49f1-8e2e-4d7242d50c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'volume_name': 'volume-2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8cd1af-263e-4e46-84e1-b8b16e5f1844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8cd1af-263e-4e46-84e1-b8b16e5f1844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afccb00-de66-47f0-95f8-d0d1dd7cc41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:53 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Volume 2a0bcee1-da2a-4ad3-84a6-e04a36276c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'volume_size': 1} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] creating volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] create volume {'name': 'v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03b1d79c-7368-42b7-a7d9-ec20888c0103 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] volume v_03b1d79c-7368-42b7-a7d9-ec20888c0103 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.quota [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Created reservations ['0fe5b14a-fa75-402d-9655-8138b07b695f', '6e14144a-9995-4997-b74f-2f34da053c8e', 'aed48ab5-2336-467f-8310-b2b9b097bb87', '30899e76-b177-49be-b2ec-a85303b638e4'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=65,cinder:UPDATE=27,cinder:DELETE=5,cinder:INSERT=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:INSERT=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot df31f8b5-2c54-4c92-ae47-c7b937f994fb for volume 64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] cloning v_64fbddc5-4def-42b8-8084-284892fa8b62 to s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'is_clone': False, 'name': 'v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afccb00-de66-47f0-95f8-d0d1dd7cc41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3535e9-f217-41c6-b10f-336ef5b22854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:47:54 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Volume volume-2a0bcee1-da2a-4ad3-84a6-e04a36276c6b (2a0bcee1-da2a-4ad3-84a6-e04a36276c6b): created successfully Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3535e9-f217-41c6-b10f-336ef5b22854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:47:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Flow 'volume_create_manager' (6e44c095-57e0-4067-a624-f9980a7cd2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:47:54 user cinder-volume[73579]: INFO cinder.volume.manager [None req-46971a42-25a8-41f5-a101-fa74009feddf tempest-VolumeRevertTests-276724201 None] Created volume successfully. Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Geting {'code': 200, 'error': None, 'data': {'available': '114294001664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.manager [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:47:55 user cinder-volume[73579]: INFO cinder.volume.manager [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Deleted volume successfully. Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.coordination [req-14253f03-2bb1-4813-a0a1-8a252e85e74c req-75f5bba0-0d34-4c7c-865e-b5acbed27fea tempest-VolumesGetTestJSON-1546803663 None] Lock "cinder-03b1d79c-7368-42b7-a7d9-ec20888c0103-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_df31f8b5-2c54-4c92-ae47-c7b937f994fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] create volume s_df31f8b5-2c54-4c92-ae47-c7b937f994fb from snapshot s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] create snapshot 6cfe988e-70ec-46a0-b2f9-11afc3f5e78b for volume 2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] cloning v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b to s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] create snapshot s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62@s_df31f8b5-2c54-4c92-ae47-c7b937f994fb', 'is_clone': True, 'full_name': 'Pool-0/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb', 'name': 's_df31f8b5-2c54-4c92-ae47-c7b937f994fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] volume s_df31f8b5-2c54-4c92-ae47-c7b937f994fb properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:47:56 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7ae59c1e-6024-4c69-bca8-b105510456ae tempest-SnapshotDataIntegrityTests-919714320 None] Create snapshot completed successfully Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] create volume s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b from snapshot s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot 757f5507-fd92-4216-a93a-ebfa57074825 for volume 64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] cloning v_64fbddc5-4def-42b8-8084-284892fa8b62 to s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b@s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b', 'is_clone': True, 'full_name': 'Pool-0/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b', 'name': 's_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] volume s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:47:58 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ab184a67-eb9f-4986-8682-f55289cd98d3 tempest-VolumeRevertTests-276724201 None] Create snapshot completed successfully Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_757f5507-fd92-4216-a93a-ebfa57074825'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] create volume s_757f5507-fd92-4216-a93a-ebfa57074825 from snapshot s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62@s_757f5507-fd92-4216-a93a-ebfa57074825', 'is_clone': True, 'full_name': 'Pool-0/s_757f5507-fd92-4216-a93a-ebfa57074825', 'name': 's_757f5507-fd92-4216-a93a-ebfa57074825'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] volume s_757f5507-fd92-4216-a93a-ebfa57074825 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:47:59 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0699cc0e-c770-4c4c-bbe4-c1ae23e791c5 tempest-SnapshotDataIntegrityTests-919714320 None] Create snapshot completed successfully Apr 14 01:47:59 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Start to perform revert to snapshot process. Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] create snapshot 539c6d03-9152-4915-96a8-b69c41446ba3 for volume 2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] cloning v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b to s_539c6d03-9152-4915-96a8-b69c41446ba3 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] create snapshot s_539c6d03-9152-4915-96a8-b69c41446ba3 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Acquiring lock "cinder-7298e05a-b142-4365-95e1-f8551de0ae79-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Lock "cinder-7298e05a-b142-4365-95e1-f8551de0ae79-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] remove_export for volume: 7298e05a-b142-4365-95e1-f8551de0ae79. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-94214556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7298e05a-b142-4365-95e1-f8551de0ae79,launched_at=2023-04-14T01:44:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4833ddea1fa74866b97ef52a730605aa',provider_auth='CHAP nmkLiNCj pQf0gyvu168tOR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:44:35Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:48:00Z,updated_at=2023-04-14T01:48:00Z,use_quota=True,user_id='f09ab986a00f43b384cf5d517857a13d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] detach volume v_7298e05a-b142-4365-95e1-f8551de0ae79 from target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns/v_7298e05a-b142-4365-95e1-f8551de0ae79'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79/luns/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] failed to remove resource iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 because of JDSS resource v_7298e05a-b142-4365-95e1-f8551de0ae79 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] delete target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] delete target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] failed to remove resource iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 because of JDSS resource iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] deleating volume v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] get snapshots for volume v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:47:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] get volume v_7298e05a-b142-4365-95e1-f8551de0ae79 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7298e05a-b142-4365-95e1-f8551de0ae79', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438085', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110495', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15046140465406003102', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dad6f688d3177bf7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293112832', 'san:volume_id': 'dad6f688d3177bf78ab4f0eb25c5db1902c749db', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82454', 'name': 'v_7298e05a-b142-4365-95e1-f8551de0ae79', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] delete volume:v_7298e05a-b142-4365-95e1-f8551de0ae79 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_539c6d03-9152-4915-96a8-b69c41446ba3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] create volume s_539c6d03-9152-4915-96a8-b69c41446ba3 from snapshot s_539c6d03-9152-4915-96a8-b69c41446ba3 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] terminate connection for 64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:48:00 user cinder-volume[73579]: INFO cinder.volume.manager [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Terminate volume connection completed successfully. Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Deleting attachment eb686bb5-ca2f-4c57-91c1-aed639bae3bb. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: 64fbddc5-4def-42b8-8084-284892fa8b62. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-356055281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64fbddc5-4def-42b8-8084-284892fa8b62,launched_at=2023-04-14T01:47:38Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP csJKGTSq oTeqrsVW7UkOd4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:37Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:48:00Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_64fbddc5-4def-42b8-8084-284892fa8b62 from target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b@s_539c6d03-9152-4915-96a8-b69c41446ba3', 'is_clone': True, 'full_name': 'Pool-0/s_539c6d03-9152-4915-96a8-b69c41446ba3', 'name': 's_539c6d03-9152-4915-96a8-b69c41446ba3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_539c6d03-9152-4915-96a8-b69c41446ba3/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_539c6d03-9152-4915-96a8-b69c41446ba3/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_539c6d03-9152-4915-96a8-b69c41446ba3/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] volume s_539c6d03-9152-4915-96a8-b69c41446ba3 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:48:01 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Create snapshot completed successfully Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] reverting v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b to s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) revert_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:420}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] get volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e req-a3db5080-2778-4ea3-b55e-e400c3bd8bf2 tempest-SnapshotDataIntegrityTests-919714320 None] target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438283', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110686', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16675613639990348748', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2e1ddb9a01133b2c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293182464', 'san:volume_id': '2e1ddb9a01133b2cbc69ae68fc45b2ae55da085d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82519', 'name': 'v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] rollback volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b to snapshot s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) rollback_volume_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:707}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/rollback {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/rollback {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7298e05a-b142-4365-95e1-f8551de0ae79 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] volume v_7298e05a-b142-4365-95e1-f8551de0ae79 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.quota [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Created reservations ['4e2cb6c5-37ae-45e3-b6fd-16d626493a6d', 'bd6dd0bf-7a18-475a-b6d4-38c037ff4fb5', '4452cc94-4679-4759-887a-67879c62b3c5', '7f1e2899-a5dd-444e-9f4a-14623bc6dc12'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293182464', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:48:02 user cinder-volume[73579]: DEBUG cinder.manager [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:48:02 user cinder-volume[73579]: INFO cinder.volume.manager [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Deleted volume successfully. Apr 14 01:48:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-96ad26f2-8bea-4244-ab71-1a778f3fff00 tempest-ServerStableDeviceRescueTest-131403183 None] Lock "cinder-7298e05a-b142-4365-95e1-f8551de0ae79-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Flow 'volume_create_manager' (04c4cbde-1934-419a-8a00-059ebda248d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d04d9d3-9f01-416e-99e4-5fc881fc60b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d04d9d3-9f01-416e-99e4-5fc881fc60b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1563275008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c09e318ab84bd18024dd5ebe85c319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:48:06Z,use_quota=True,user_id='b4805ea85abe4a4e89057b44e960e2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a728d3-ea51-48e2-9118-b6dc028d4a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a728d3-ea51-48e2-9118-b6dc028d4a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e91c6c-5693-417e-9121-5b1ae975f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e91c6c-5693-417e-9121-5b1ae975f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'volume_name': 'volume-c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e704088-0c87-4043-bd1d-af27d07ddf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e704088-0c87-4043-bd1d-af27d07ddf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14aba525-2dfb-4255-9d56-65685ee3fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:05 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Volume c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'volume_size': 1} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] creating volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] create volume {'name': 'v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': None} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/rollback {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] get volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438283', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110686', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16675613639990348748', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2e1ddb9a01133b2c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293125120', 'san:volume_id': '2e1ddb9a01133b2cbc69ae68fc45b2ae55da085d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82519', 'name': 'v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Acquiring lock "cinder-539c6d03-9152-4915-96a8-b69c41446ba3-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Lock "cinder-539c6d03-9152-4915-96a8-b69c41446ba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] deleating snapshot s_539c6d03-9152-4915-96a8-b69c41446ba3. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] get snapshots for volume s_539c6d03-9152-4915-96a8-b69c41446ba3 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_539c6d03-9152-4915-96a8-b69c41446ba3/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_539c6d03-9152-4915-96a8-b69c41446ba3/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Geting {'code': 500, 'error': {'class': 'zfslib.zfsapi.resources.ZfsResourceError', 'errno': 1, 'message': 'Zfs resource: Pool-0/s_539c6d03-9152-4915-96a8-b69c41446ba3 not found in this collection.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_539c6d03-9152-4915-96a8-b69c41446ba3/snapshots'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_539c6d03-9152-4915-96a8-b69c41446ba3/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] physical volume s_539c6d03-9152-4915-96a8-b69c41446ba3 dne, it was already deleted. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:655}} Apr 14 01:48:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Delete snapshot completed successfully. Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Lock "cinder-539c6d03-9152-4915-96a8-b69c41446ba3-delete_snapshot" released by "delete_snapshot" :: held 0.046s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f57ad96f-bce4-4c59-aa52-9d7d6755d304 tempest-VolumeRevertTests-276724201 None] Volume 2a0bcee1-da2a-4ad3-84a6-e04a36276c6b reverted to snapshot 6cfe988e-70ec-46a0-b2f9-11afc3f5e78b successfully. Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'is_clone': False, 'name': 'v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14aba525-2dfb-4255-9d56-65685ee3fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5ae5d4-b82b-4a3c-b7e2-b180c2334c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:06 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Volume volume-c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 (c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5): created successfully Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5ae5d4-b82b-4a3c-b7e2-b180c2334c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Flow 'volume_create_manager' (04c4cbde-1934-419a-8a00-059ebda248d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-48d1fa4d-5ae7-4dcc-b3dd-cce316a6faf1 tempest-SnapshotsActionsTest-110488970 None] Created volume successfully. Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] create snapshot 43b00288-7b9a-48a3-bca6-24b5dc684225 for volume c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] cloning v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 to s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] create snapshot s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Flow 'volume_create_manager' (7d81791e-25fb-4d22-921f-9144772db894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001b66fd-9f33-41b9-8418-e54974762225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001b66fd-9f33-41b9-8418-e54974762225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-742258302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2904c37d-3768-4445-af44-1676378fd233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca7c280d61047f4a679e9d31c687d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:48:07Z,use_quota=True,user_id='5a9059be430640e9bb9744bd6ef9d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854e17e4-8fe9-4a7d-a712-c124db645897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854e17e4-8fe9-4a7d-a712-c124db645897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c35b809-5b54-47e4-b824-3e59496fd4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c35b809-5b54-47e4-b824-3e59496fd4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2904c37d-3768-4445-af44-1676378fd233', 'volume_name': 'volume-2904c37d-3768-4445-af44-1676378fd233', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036686ff-1eb2-4301-8175-9246b5a1ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036686ff-1eb2-4301-8175-9246b5a1ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267ee78a-12d0-4ddf-b510-0046821c20cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:07 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Volume 2904c37d-3768-4445-af44-1676378fd233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2904c37d-3768-4445-af44-1676378fd233', 'volume_size': 1} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] creating volume v_2904c37d-3768-4445-af44-1676378fd233. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] create volume {'name': 'v_2904c37d-3768-4445-af44-1676378fd233', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_43b00288-7b9a-48a3-bca6-24b5dc684225'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] create volume s_43b00288-7b9a-48a3-bca6-24b5dc684225 from snapshot s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2904c37d-3768-4445-af44-1676378fd233', 'is_clone': False, 'name': 'v_2904c37d-3768-4445-af44-1676378fd233'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267ee78a-12d0-4ddf-b510-0046821c20cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2904c37d-3768-4445-af44-1676378fd233', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2233a415-b14f-419a-bb25-e25655c10603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:08 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Volume volume-2904c37d-3768-4445-af44-1676378fd233 (2904c37d-3768-4445-af44-1676378fd233): created successfully Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2233a415-b14f-419a-bb25-e25655c10603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Flow 'volume_create_manager' (7d81791e-25fb-4d22-921f-9144772db894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b9e53d85-3cff-47f9-81c0-21d0a77ae286 tempest-VolumeRevertTests-276724201 None] Created volume successfully. Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_43b00288-7b9a-48a3-bca6-24b5dc684225', 'is_clone': True, 'full_name': 'Pool-0/s_43b00288-7b9a-48a3-bca6-24b5dc684225', 'name': 's_43b00288-7b9a-48a3-bca6-24b5dc684225'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] volume s_43b00288-7b9a-48a3-bca6-24b5dc684225 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:48:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ff98f5f3-1c71-4056-8dca-ccbbda4264c8 tempest-SnapshotsActionsTest-110488970 None] Create snapshot completed successfully Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] create snapshot 45ee5f35-a124-47df-8f4e-5b2f8bcdae2f for volume c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] cloning v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 to s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] create snapshot s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] create snapshot 317a29a7-e8b4-4fa8-a152-9314796f2f52 for volume 2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] cloning v_2904c37d-3768-4445-af44-1676378fd233 to s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] create snapshot s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_317a29a7-e8b4-4fa8-a152-9314796f2f52'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] create volume s_317a29a7-e8b4-4fa8-a152-9314796f2f52 from snapshot s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] create volume s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f from snapshot s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2904c37d-3768-4445-af44-1676378fd233@s_317a29a7-e8b4-4fa8-a152-9314796f2f52', 'is_clone': True, 'full_name': 'Pool-0/s_317a29a7-e8b4-4fa8-a152-9314796f2f52', 'name': 's_317a29a7-e8b4-4fa8-a152-9314796f2f52'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f', 'is_clone': True, 'full_name': 'Pool-0/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f', 'name': 's_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] volume s_317a29a7-e8b4-4fa8-a152-9314796f2f52 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] volume s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:48:11 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=33,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:11 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d0b322bb-c23b-48e2-9f25-51226da84c12 tempest-VolumeRevertTests-276724201 None] Create snapshot completed successfully Apr 14 01:48:11 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b05b1f4f-cb55-43ae-bf02-ff23168f5300 tempest-SnapshotsActionsTest-110488970 None] Create snapshot completed successfully Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6c9dc68b-31fd-48e2-840f-5d889861a795 tempest-VolumeRevertTests-276724201 None] Extend volume 2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6c9dc68b-31fd-48e2-840f-5d889861a795 tempest-VolumeRevertTests-276724201 None] jdss extend volume v_2904c37d-3768-4445-af44-1676378fd233 to 2147483648 {{(pid=73579) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6c9dc68b-31fd-48e2-840f-5d889861a795 tempest-VolumeRevertTests-276724201 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6c9dc68b-31fd-48e2-840f-5d889861a795 tempest-VolumeRevertTests-276724201 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Acquiring lock "cinder-45ee5f35-a124-47df-8f4e-5b2f8bcdae2f-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-45ee5f35-a124-47df-8f4e-5b2f8bcdae2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] deleating snapshot s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] get snapshots for volume s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6c9dc68b-31fd-48e2-840f-5d889861a795 tempest-VolumeRevertTests-276724201 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:13 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6c9dc68b-31fd-48e2-840f-5d889861a795 tempest-VolumeRevertTests-276724201 None] Extend volume completed successfully. Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] get volume s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438300', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110745', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12908658132498920284', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f9ef8608417bf320', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292875264', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81366', 'name': 's_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] delete snapshot s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f of volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Acquiring lock "cinder-317a29a7-e8b4-4fa8-a152-9314796f2f52-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Lock "cinder-317a29a7-e8b4-4fa8-a152-9314796f2f52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] deleating snapshot s_317a29a7-e8b4-4fa8-a152-9314796f2f52. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] get snapshots for volume s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] get volume s_317a29a7-e8b4-4fa8-a152-9314796f2f52 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2904c37d-3768-4445-af44-1676378fd233@s_317a29a7-e8b4-4fa8-a152-9314796f2f52', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_317a29a7-e8b4-4fa8-a152-9314796f2f52', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438300', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110744', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7575818268651235365', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4a0bc135a2b49968', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292899840', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81356', 'name': 's_317a29a7-e8b4-4fa8-a152-9314796f2f52', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] delete snapshot s_317a29a7-e8b4-4fa8-a152-9314796f2f52 of volume v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots/s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots/s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] snapshot s_45ee5f35-a124-47df-8f4e-5b2f8bcdae2f deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=27,cinder:SELECT=65,cinder:DELETE=5,cinder:INSERT=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.quota [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Created reservations ['acc5ffba-737a-4676-b434-73887deaeaee', '165f6d4c-5993-4925-b143-98a0ae64c5f1', '75534338-e724-4279-ae77-aaa54dc31eca', '6973544e-c566-49d0-8edc-c9e5d39e0bb9'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:14 user cinder-volume[73579]: INFO cinder.volume.manager [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Delete snapshot completed successfully. Apr 14 01:48:14 user cinder-volume[73579]: DEBUG cinder.coordination [None req-30b91276-c5b1-4242-948c-6191a8b2464a tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-45ee5f35-a124-47df-8f4e-5b2f8bcdae2f-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] terminate connection for dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:48:15 user cinder-volume[73579]: INFO cinder.volume.manager [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Terminate volume connection completed successfully. Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Deleting attachment 39b50bc8-687b-4ade-ba07-779569acf68f. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] remove_export for volume: dccc3a21-0674-4347-842b-3d0354dfdfa8. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1738533660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=dccc3a21-0674-4347-842b-3d0354dfdfa8,launched_at=2023-04-14T01:46:02Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth='CHAP pnIKHyQa dZFLKjY3abIOl9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:00Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:46:22Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 from target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] delete target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] delete target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-4b4a4947-f5f8-4543-9852-b70ecfe261ce tempest-TaggedBootDevicesTest_v242-819739955 None] target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots/s_317a29a7-e8b4-4fa8-a152-9314796f2f52 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] snapshot s_317a29a7-e8b4-4fa8-a152-9314796f2f52 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.quota [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Created reservations ['743d8022-a533-470b-a214-e677d566acf6', '3dcb1873-4726-45c0-b0c0-cd3fb08b5e0e', 'bd5bb386-dbab-42d5-ba8b-ec55dc318fa3', '717bdefd-8fa3-4500-af9c-f5878315e570'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] create snapshot 81c29603-98fc-4b02-9b72-058fa4304d37 for volume c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] cloning v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 to s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] create snapshot s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] terminate connection for f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:48:16 user cinder-volume[73579]: INFO cinder.volume.manager [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Terminate volume connection completed successfully. Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Deleting attachment 28e490a1-0ef3-4608-89a5-7f290c91b23b. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] remove_export for volume: f01988fc-537f-4359-9b58-2a3f4752251b. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1093534964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f01988fc-537f-4359-9b58-2a3f4752251b,launched_at=2023-04-14T01:46:05Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth='CHAP lUEoPgwk KwemOhYAgVRMSH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:46:26Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume v_f01988fc-537f-4359-9b58-2a3f4752251b from target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Delete snapshot completed successfully. Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6408b3bf-8cf7-41a3-8fab-10d7eb21d9ef tempest-VolumeRevertTests-276724201 None] Lock "cinder-317a29a7-e8b4-4fa8-a152-9314796f2f52-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-6e132841-48a5-4aec-a7cf-dc4995e3bfc9 tempest-TaggedBootDevicesTest_v242-819739955 None] target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] terminate connection for ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:48:17 user cinder-volume[73579]: INFO cinder.volume.manager [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Terminate volume connection completed successfully. Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Deleting attachment 4cee129c-6fa5-4659-99e5-1312f60e47ad. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] remove_export for volume: ae6f77e9-ea6d-4653-9cd8-5944d88d743d. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-598851587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ae6f77e9-ea6d-4653-9cd8-5944d88d743d,launched_at=2023-04-14T01:46:06Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth='CHAP wdltqivh 4LYapUDdE8GHe1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:05Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:46:32Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d from target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Acquiring lock "cinder-2904c37d-3768-4445-af44-1676378fd233-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Lock "cinder-2904c37d-3768-4445-af44-1676378fd233-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] remove_export for volume: 2904c37d-3768-4445-af44-1676378fd233. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-742258302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2904c37d-3768-4445-af44-1676378fd233,launched_at=2023-04-14T01:48:08Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='4ca7c280d61047f4a679e9d31c687d98',provider_auth='CHAP tufmLnRj gmA3X6aRZiN8tq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:07Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:48:17Z,updated_at=2023-04-14T01:48:17Z,use_quota=True,user_id='5a9059be430640e9bb9744bd6ef9d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] detach volume v_2904c37d-3768-4445-af44-1676378fd233 from target iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233/luns/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233/luns/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233/luns/v_2904c37d-3768-4445-af44-1676378fd233'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233/luns/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] failed to remove resource iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 because of JDSS resource v_2904c37d-3768-4445-af44-1676378fd233 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] delete target: iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] delete target iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] failed to remove resource iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 because of JDSS resource iqn.2010-10.org.openstack:2904c37d-3768-4445-af44-1676378fd233 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] deleating volume v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] get snapshots for volume v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_81c29603-98fc-4b02-9b72-058fa4304d37'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] create volume s_81c29603-98fc-4b02-9b72-058fa4304d37 from snapshot s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] get volume v_2904c37d-3768-4445-af44-1676378fd233 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2904c37d-3768-4445-af44-1676378fd233', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438297', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110728', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8070884057000813603', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5a11a6d8ab852eca', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292944896', 'san:volume_id': '5a11a6d8ab852eca2c0e34d7090bbd42521c08c3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81591', 'name': 'v_2904c37d-3768-4445-af44-1676378fd233', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] delete volume:v_2904c37d-3768-4445-af44-1676378fd233 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a42dd672-ed47-45bd-a168-9263ab872d59 req-3887b23d-cbca-4999-828f-24f3e0156964 tempest-TaggedBootDevicesTest_v242-819739955 None] target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_81c29603-98fc-4b02-9b72-058fa4304d37', 'is_clone': True, 'full_name': 'Pool-0/s_81c29603-98fc-4b02-9b72-058fa4304d37', 'name': 's_81c29603-98fc-4b02-9b72-058fa4304d37'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Flow 'volume_create_manager' (9237048b-49cd-4cf8-9392-4a8181ae059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8fcca4-df12-45e4-9bec-2138dfbf91be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8fcca4-df12-45e4-9bec-2138dfbf91be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1206932234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5c9a8475-2b28-4660-8c4a-197d3b9b2334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907f632263e04bf2a6c8ff1bae77a5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:48:18Z,use_quota=True,user_id='236828e284154097a25f59eaedf47c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e61990-9779-45d2-9c58-4f79a99fa0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e61990-9779-45d2-9c58-4f79a99fa0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b5abbc-4851-4e39-bb7a-edab0c21abe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b5abbc-4851-4e39-bb7a-edab0c21abe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'volume_name': 'volume-5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2b1ef2-481e-40cf-8eba-8f2f5dd61347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2b1ef2-481e-40cf-8eba-8f2f5dd61347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0686dd0a-b660-4ee0-9bb8-108db0f324ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:18 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Volume 5c9a8475-2b28-4660-8c4a-197d3b9b2334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'volume_size': 1} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] creating volume v_5c9a8475-2b28-4660-8c4a-197d3b9b2334. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] create volume {'name': 'v_5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] volume s_81c29603-98fc-4b02-9b72-058fa4304d37 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:48:18 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e7c9fd8e-de26-4a9f-9ef6-a2141dc0da25 tempest-SnapshotsActionsTest-110488970 None] Create snapshot completed successfully Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Acquiring lock "cinder-81c29603-98fc-4b02-9b72-058fa4304d37-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'is_clone': False, 'name': 'v_5c9a8475-2b28-4660-8c4a-197d3b9b2334'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0686dd0a-b660-4ee0-9bb8-108db0f324ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9aa98d-d998-4f1f-a612-1eb5f8d2e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.coordination [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-81c29603-98fc-4b02-9b72-058fa4304d37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] deleating snapshot s_81c29603-98fc-4b02-9b72-058fa4304d37. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] get snapshots for volume s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:19 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Volume volume-5c9a8475-2b28-4660-8c4a-197d3b9b2334 (5c9a8475-2b28-4660-8c4a-197d3b9b2334): created successfully Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9aa98d-d998-4f1f-a612-1eb5f8d2e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Flow 'volume_create_manager' (9237048b-49cd-4cf8-9392-4a8181ae059f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:19 user cinder-volume[73579]: INFO cinder.volume.manager [None req-57bc0481-269b-4695-8aec-c2b802af469d tempest-ServersNegativeTestJSON-1259366012 None] Created volume successfully. Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2904c37d-3768-4445-af44-1676378fd233 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] volume v_2904c37d-3768-4445-af44-1676378fd233 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.quota [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Created reservations ['dfbd6d7b-cbaa-49a9-a91f-a8a674312930', 'cc819ada-2ff0-448a-8fb7-195c616d5f4d', '5f60ed73-9930-4405-bc35-18c68f5f31f0', 'bda86f6b-ef2f-4480-89a2-1d5a83283162'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] get volume s_81c29603-98fc-4b02-9b72-058fa4304d37 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_81c29603-98fc-4b02-9b72-058fa4304d37', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_81c29603-98fc-4b02-9b72-058fa4304d37', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438306', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110763', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18321418344156147929', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dc55ff1ceef2c8a9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292957184', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81632', 'name': 's_81c29603-98fc-4b02-9b72-058fa4304d37', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] delete snapshot s_81c29603-98fc-4b02-9b72-058fa4304d37 of volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'available': '114292957184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.manager [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Acquiring lock "cinder-6cfe988e-70ec-46a0-b2f9-11afc3f5e78b-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Deleted volume successfully. Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Lock "cinder-6cfe988e-70ec-46a0-b2f9-11afc3f5e78b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] deleating snapshot s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] get snapshots for volume s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-19fac0ab-1469-41d8-825b-1fc18f0f7dd8 tempest-VolumeRevertTests-276724201 None] Lock "cinder-2904c37d-3768-4445-af44-1676378fd233-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] get volume s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b@s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438286', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110699', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10063476848511287611', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'abdd5bcc0d4a2048', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292944896', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81983', 'name': 's_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] delete snapshot s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b of volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_81c29603-98fc-4b02-9b72-058fa4304d37 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] snapshot s_81c29603-98fc-4b02-9b72-058fa4304d37 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.quota [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Created reservations ['18dacdfb-e597-42f3-a58c-3ba6c1715880', 'ccfff04c-5e83-4b9c-9d4d-9529f3969bd6', 'badfe85b-3765-4394-85f1-dc8581c50948', '0cc2a255-649c-45a6-8c0e-3ff455d870ef'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:21 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:DELETE=2,cinder:SELECT=62,cinder:UPDATE=27,cinder:INSERT=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Delete snapshot completed successfully. Apr 14 01:48:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-23fd52ab-81f7-4b39-a73c-66cad880cab3 tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-81c29603-98fc-4b02-9b72-058fa4304d37-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots/s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] snapshot s_6cfe988e-70ec-46a0-b2f9-11afc3f5e78b deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.quota [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Created reservations ['de31d8a2-f4b1-46e9-be2e-dfad3497eb48', 'd591a7d3-e79b-4003-afba-b7a989c4e081', 'f3f93f72-b33a-4e16-b0b4-c4438c73003f', 'b732228f-2135-443d-b558-4ad0059337e8'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] create snapshot f9690d84-5609-4de7-8158-0ec214631e36 for volume c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] cloning v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 to s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] create snapshot s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Delete snapshot completed successfully. Apr 14 01:48:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-cce700a7-c156-490e-ad59-5d9497e06756 tempest-VolumeRevertTests-276724201 None] Lock "cinder-6cfe988e-70ec-46a0-b2f9-11afc3f5e78b-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Acquiring lock "cinder-2a0bcee1-da2a-4ad3-84a6-e04a36276c6b-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Lock "cinder-2a0bcee1-da2a-4ad3-84a6-e04a36276c6b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] remove_export for volume: 2a0bcee1-da2a-4ad3-84a6-e04a36276c6b. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1493946080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2a0bcee1-da2a-4ad3-84a6-e04a36276c6b,launched_at=2023-04-14T01:47:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca7c280d61047f4a679e9d31c687d98',provider_auth='CHAP rTuljBtV WZcqy67NQHsGuS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:54Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:48:24Z,updated_at=2023-04-14T01:48:24Z,use_quota=True,user_id='5a9059be430640e9bb9744bd6ef9d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] detach volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b from target iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/luns/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/luns/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/luns/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/luns/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] failed to remove resource iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b because of JDSS resource v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] delete target: iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] delete target iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] failed to remove resource iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b because of JDSS resource iqn.2010-10.org.openstack:2a0bcee1-da2a-4ad3-84a6-e04a36276c6b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] deleating volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] get snapshots for volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f9690d84-5609-4de7-8158-0ec214631e36'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] create volume s_f9690d84-5609-4de7-8158-0ec214631e36 from snapshot s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] get volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438283', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110686', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16675613639990348748', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2e1ddb9a01133b2c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292961280', 'san:volume_id': '2e1ddb9a01133b2cbc69ae68fc45b2ae55da085d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82519', 'name': 'v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] delete volume:v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_f9690d84-5609-4de7-8158-0ec214631e36', 'is_clone': True, 'full_name': 'Pool-0/s_f9690d84-5609-4de7-8158-0ec214631e36', 'name': 's_f9690d84-5609-4de7-8158-0ec214631e36'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] volume s_f9690d84-5609-4de7-8158-0ec214631e36 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:48:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-155fcc91-82e5-430e-b855-d7812c053a74 tempest-SnapshotsActionsTest-110488970 None] Create snapshot completed successfully Apr 14 01:48:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] volume v_2a0bcee1-da2a-4ad3-84a6-e04a36276c6b deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:48:25 user cinder-volume[73579]: DEBUG cinder.quota [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Created reservations ['919d68d7-c9aa-4931-aa02-0c20f2d242c6', 'fd4a2055-f221-4380-be81-4978fef074f4', 'b54ccc10-1b80-4b20-af94-0e645f8e0af6', '362e2d83-daf5-401d-9e45-40a1696a9972'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:48:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:48:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Acquiring lock "cinder-f9690d84-5609-4de7-8158-0ec214631e36-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-f9690d84-5609-4de7-8158-0ec214631e36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] deleating snapshot s_f9690d84-5609-4de7-8158-0ec214631e36. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] get snapshots for volume s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293043200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.manager [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:48:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Deleted volume successfully. Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1cdb195d-86b6-498a-b3d3-d858df51ca46 tempest-VolumeRevertTests-276724201 None] Lock "cinder-2a0bcee1-da2a-4ad3-84a6-e04a36276c6b-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] get volume s_f9690d84-5609-4de7-8158-0ec214631e36 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_f9690d84-5609-4de7-8158-0ec214631e36', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f9690d84-5609-4de7-8158-0ec214631e36', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438313', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110781', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5448437563528656378', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5ed8d1af619763f1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293043200', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82005', 'name': 's_f9690d84-5609-4de7-8158-0ec214631e36', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] delete snapshot s_f9690d84-5609-4de7-8158-0ec214631e36 of volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_f9690d84-5609-4de7-8158-0ec214631e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] snapshot s_f9690d84-5609-4de7-8158-0ec214631e36 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:48:28 user cinder-volume[73579]: DEBUG cinder.quota [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Created reservations ['5305811d-0e90-4008-95e5-30467c6bfeb9', '67d5bc63-6c30-483d-b280-628a75990640', '60f7d021-5682-49dd-8570-37212be37aae', '3394f4fa-7433-47e0-9b8f-7e7c5855d09b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Delete snapshot completed successfully. Apr 14 01:48:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-36273c30-280b-4348-8744-2c3a80f319bc tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-f9690d84-5609-4de7-8158-0ec214631e36-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] create snapshot 2e6f1e43-ff0c-493a-923e-1ca5995e58da for volume c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:48:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] cloning v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 to s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:48:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] create snapshot s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:48:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_2e6f1e43-ff0c-493a-923e-1ca5995e58da'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] create volume s_2e6f1e43-ff0c-493a-923e-1ca5995e58da from snapshot s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_2e6f1e43-ff0c-493a-923e-1ca5995e58da', 'is_clone': True, 'full_name': 'Pool-0/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da', 'name': 's_2e6f1e43-ff0c-493a-923e-1ca5995e58da'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114292994048', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] volume s_2e6f1e43-ff0c-493a-923e-1ca5995e58da properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:48:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2ea83921-de73-4f46-90f3-24ffe2fde58f tempest-SnapshotsActionsTest-110488970 None] Create snapshot completed successfully Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Acquiring lock "cinder-2e6f1e43-ff0c-493a-923e-1ca5995e58da-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-2e6f1e43-ff0c-493a-923e-1ca5995e58da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] deleating snapshot s_2e6f1e43-ff0c-493a-923e-1ca5995e58da. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] get snapshots for volume s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] get volume s_2e6f1e43-ff0c-493a-923e-1ca5995e58da info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_2e6f1e43-ff0c-493a-923e-1ca5995e58da', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438320', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110792', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14719821136707958996', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9df475be6272afa9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292994048', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81381', 'name': 's_2e6f1e43-ff0c-493a-923e-1ca5995e58da', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] delete snapshot s_2e6f1e43-ff0c-493a-923e-1ca5995e58da of volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_2e6f1e43-ff0c-493a-923e-1ca5995e58da {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] snapshot s_2e6f1e43-ff0c-493a-923e-1ca5995e58da deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:48:34 user cinder-volume[73579]: DEBUG cinder.quota [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Created reservations ['23539436-3090-4229-9d9d-3b1877d8dd59', 'f5b395f9-b138-45b7-9e99-9f6740decddb', 'e9eab0ac-bbb1-4775-8d58-0d21158f041a', '94765118-928f-467d-b453-2b9c12d974b5'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:34 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Delete snapshot completed successfully. Apr 14 01:48:34 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ae6feaad-bb39-4233-a22e-3b677b7e2a58 tempest-SnapshotsActionsTest-752076320 None] Lock "cinder-2e6f1e43-ff0c-493a-923e-1ca5995e58da-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Acquiring lock "cinder-43b00288-7b9a-48a3-bca6-24b5dc684225-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Lock "cinder-43b00288-7b9a-48a3-bca6-24b5dc684225-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] deleating snapshot s_43b00288-7b9a-48a3-bca6-24b5dc684225. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] get snapshots for volume s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] get volume s_43b00288-7b9a-48a3-bca6-24b5dc684225 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5@s_43b00288-7b9a-48a3-bca6-24b5dc684225', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_43b00288-7b9a-48a3-bca6-24b5dc684225', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438297', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110731', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11348068644731802018', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '72510855ace36dea', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293018624', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81599', 'name': 's_43b00288-7b9a-48a3-bca6-24b5dc684225', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] delete snapshot s_43b00288-7b9a-48a3-bca6-24b5dc684225 of volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:48:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots/s_43b00288-7b9a-48a3-bca6-24b5dc684225 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] snapshot s_43b00288-7b9a-48a3-bca6-24b5dc684225 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:48:37 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=56,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:37 user cinder-volume[73579]: DEBUG cinder.quota [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Created reservations ['80891081-1412-4f98-a4ae-1fcdc44f9950', '37137847-e71c-43cc-972c-4473b857fbb8', '2f667880-0710-41cc-8b55-0d57a8dd4058', '070a9f87-9518-4f16-8312-cc2755406ed7'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:37 user cinder-volume[73579]: INFO cinder.volume.manager [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Delete snapshot completed successfully. Apr 14 01:48:37 user cinder-volume[73579]: DEBUG cinder.coordination [None req-14f591fe-ce61-4760-80b7-4fc24e39a2c5 tempest-SnapshotsActionsTest-110488970 None] Lock "cinder-43b00288-7b9a-48a3-bca6-24b5dc684225-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Acquiring lock "cinder-c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Lock "cinder-c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] remove_export for volume: c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1563275008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5,launched_at=2023-04-14T01:48:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c09e318ab84bd18024dd5ebe85c319',provider_auth='CHAP KmulzRJY 4CwPgpXxOfnZHG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:06Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:48:38Z,updated_at=2023-04-14T01:48:38Z,use_quota=True,user_id='b4805ea85abe4a4e89057b44e960e2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] detach volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 from target iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/luns/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/luns/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/luns/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/luns/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] failed to remove resource iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 because of JDSS resource v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] delete target: iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] delete target iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] failed to remove resource iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 because of JDSS resource iqn.2010-10.org.openstack:c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] deleating volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] get snapshots for volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] get volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438295', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110722', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10501790980955759848', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2d24b0a224ff6f65', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293006336', 'san:volume_id': '2d24b0a224ff6f65dbbb634dda8113f3ea17545e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81578', 'name': 'v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] delete volume:v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] volume v_c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:INSERT=10 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG cinder.quota [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Created reservations ['dff3b294-9a65-4dc1-ab58-24229a68a12c', '5d4aa67e-4611-47dc-b761-3eec928b3152', '115745cf-960f-43ff-a2af-bb79c69a0daa', '5384d98e-4737-4178-9819-3a2b1bf3e065'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293100544', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:48:41 user cinder-volume[73579]: DEBUG cinder.manager [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:48:41 user cinder-volume[73579]: INFO cinder.volume.manager [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Deleted volume successfully. Apr 14 01:48:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-89b2df1a-658f-4d72-8049-e0a8646a6b81 tempest-SnapshotsActionsTest-110488970 None] Lock "cinder-c9bd57dd-4b2f-4714-9e79-0d33d7f4a0a5-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Flow 'volume_create_manager' (146052e1-c9e1-4783-90b4-65e2b0e2f0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e76af6e-8de2-4867-99a1-d0ea72e2b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e76af6e-8de2-4867-99a1-d0ea72e2b892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-754530480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d468b424-6bfa-4c8d-88ab-05305be5f3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b31b78c0e5d48a4a9205bac0f11d7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:48:49Z,use_quota=True,user_id='578da9952d094acba1c32b2d89432c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3540bdc6-3e3b-40b4-8025-337dbbb66651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3540bdc6-3e3b-40b4-8025-337dbbb66651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4210732b-666f-418e-bcce-e9dca5f6d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4210732b-666f-418e-bcce-e9dca5f6d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd468b424-6bfa-4c8d-88ab-05305be5f3b8', 'volume_name': 'volume-d468b424-6bfa-4c8d-88ab-05305be5f3b8', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2f024e-7f0c-4e72-b0d6-3109ef8b089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2f024e-7f0c-4e72-b0d6-3109ef8b089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d6cf91-6457-4e39-858d-6384bde79fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:49 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Volume d468b424-6bfa-4c8d-88ab-05305be5f3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d468b424-6bfa-4c8d-88ab-05305be5f3b8', 'volume_size': 1} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] creating volume v_d468b424-6bfa-4c8d-88ab-05305be5f3b8. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] create volume {'name': 'v_d468b424-6bfa-4c8d-88ab-05305be5f3b8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (9767d71e-aa4f-4543-b055-87ded71e5ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e08326-3031-404f-a761-cd822eaaacff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e08326-3031-404f-a761-cd822eaaacff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1975546726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e59663b0-f628-4a16-8c39-38b28a9a8530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c240a035-a4c9-4b0f-9e37-04d8aea59cb8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:48:50Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6636b955-0e7e-4b6a-a8fd-1f3ff2aabad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6636b955-0e7e-4b6a-a8fd-1f3ff2aabad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69b09f-9e9e-432f-95db-3f1a3499643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69b09f-9e9e-432f-95db-3f1a3499643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e59663b0-f628-4a16-8c39-38b28a9a8530', 'volume_name': 'volume-e59663b0-f628-4a16-8c39-38b28a9a8530', 'volume_size': 1, 'snapshot_id': 'c240a035-a4c9-4b0f-9e37-04d8aea59cb8'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b644f0-3c33-48f8-94ac-acd9daa17a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b644f0-3c33-48f8-94ac-acd9daa17a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f18336-9b4c-4732-b198-486a9eb7d1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:50 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Volume e59663b0-f628-4a16-8c39-38b28a9a8530: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e59663b0-f628-4a16-8c39-38b28a9a8530', 'volume_size': 1, 'snapshot_id': 'c240a035-a4c9-4b0f-9e37-04d8aea59cb8'} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] create volume e59663b0-f628-4a16-8c39-38b28a9a8530 from snapshot c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] cloning s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 to v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8', 'is_clone': False, 'name': 'v_d468b424-6bfa-4c8d-88ab-05305be5f3b8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d6cf91-6457-4e39-858d-6384bde79fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d468b424-6bfa-4c8d-88ab-05305be5f3b8', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b9fae2-7cee-4d83-aa51-d82dacbc2466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:50 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Volume volume-d468b424-6bfa-4c8d-88ab-05305be5f3b8 (d468b424-6bfa-4c8d-88ab-05305be5f3b8): created successfully Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b9fae2-7cee-4d83-aa51-d82dacbc2466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Flow 'volume_create_manager' (146052e1-c9e1-4783-90b4-65e2b0e2f0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0a55712e-8448-4604-a7cc-b5cfa39cfa8e tempest-VolumeQuotasAdminTestJSON-312843163 None] Created volume successfully. Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e59663b0-f628-4a16-8c39-38b28a9a8530'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] create volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 from snapshot v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.coordination [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Acquiring lock "cinder-d468b424-6bfa-4c8d-88ab-05305be5f3b8-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.coordination [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Lock "cinder-d468b424-6bfa-4c8d-88ab-05305be5f3b8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] remove_export for volume: d468b424-6bfa-4c8d-88ab-05305be5f3b8. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-754530480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d468b424-6bfa-4c8d-88ab-05305be5f3b8,launched_at=2023-04-14T01:48:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b31b78c0e5d48a4a9205bac0f11d7f9',provider_auth='CHAP dEUCacno HI7aRUpLXnBFQE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:49Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:48:51Z,updated_at=2023-04-14T01:48:51Z,use_quota=True,user_id='578da9952d094acba1c32b2d89432c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] detach volume v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 from target iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8/luns/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8/luns/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8/luns/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8/luns/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] failed to remove resource iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 because of JDSS resource v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] delete target: iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] delete target iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] failed to remove resource iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 because of JDSS resource iqn.2010-10.org.openstack:d468b424-6bfa-4c8d-88ab-05305be5f3b8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] deleating volume v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] get snapshots for volume v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] get volume v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438339', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110806', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11233097347266762362', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '14fc4da9db3dd9a3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292944896', 'san:volume_id': '14fc4da9db3dd9a37c2952232833c2eec96f002f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81655', 'name': 'v_d468b424-6bfa-4c8d-88ab-05305be5f3b8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] delete volume:v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8@v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'is_clone': True, 'full_name': 'Pool-0/v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'name': 'v_e59663b0-f628-4a16-8c39-38b28a9a8530'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] get volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8@v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438340', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '110812', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1497690921485351853', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '29b1b86d8400bd56', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292944896', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83204', 'name': 'v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f18336-9b4c-4732-b198-486a9eb7d1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59663b0-f628-4a16-8c39-38b28a9a8530', 'volume_size': 1, 'snapshot_id': 'c240a035-a4c9-4b0f-9e37-04d8aea59cb8'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a3985d-f94f-4428-a10b-5621112075cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:52 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Volume volume-e59663b0-f628-4a16-8c39-38b28a9a8530 (e59663b0-f628-4a16-8c39-38b28a9a8530): created successfully Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a3985d-f94f-4428-a10b-5621112075cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (9767d71e-aa4f-4543-b055-87ded71e5ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:52 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5a49bc38-7191-4e5e-b9bf-763a0e2edb9c tempest-SnapshotDataIntegrityTests-919714320 None] Created volume successfully. Apr 14 01:48:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] volume v_d468b424-6bfa-4c8d-88ab-05305be5f3b8 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:48:53 user cinder-volume[73579]: DEBUG cinder.quota [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Created reservations ['82441957-550f-4b8f-a3f0-a281dbae54a8', '0637f510-64cf-4164-8522-eb13b490255d', '7d4dc92f-e951-48f0-9f24-c6ee0dbfd51c', 'e9ceebd2-991d-4a4f-8234-e6b312b4899b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:48:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:48:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:48:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] create export for volume: e59663b0-f628-4a16-8c39-38b28a9a8530. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] ensure volume e59663b0-f628-4a16-8c39-38b28a9a8530 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] check if targe iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] create target and attach volume e59663b0-f628-4a16-8c39-38b28a9a8530 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] create target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293014528', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.manager [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:48:54 user cinder-volume[73579]: INFO cinder.volume.manager [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Deleted volume successfully. Apr 14 01:48:54 user cinder-volume[73579]: DEBUG cinder.coordination [None req-db643451-4674-4147-b28b-13e5a5b06566 tempest-VolumeQuotasAdminTestJSON-312843163 None] Lock "cinder-d468b424-6bfa-4c8d-88ab-05305be5f3b8-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Flow 'volume_create_manager' (8b44cac5-8552-4692-b6b2-517b4d5d0353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dcdb4e-2186-47dd-a3f9-5985c102d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dcdb4e-2186-47dd-a3f9-5985c102d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1465701619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e1322275-82d0-4c3a-9341-d2ae7e34733c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b31b78c0e5d48a4a9205bac0f11d7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:48:55Z,use_quota=True,user_id='578da9952d094acba1c32b2d89432c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57937858-4938-4a33-a1fe-4d6552178945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57937858-4938-4a33-a1fe-4d6552178945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03c317a-575c-4499-9f09-a9c00b803773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03c317a-575c-4499-9f09-a9c00b803773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1322275-82d0-4c3a-9341-d2ae7e34733c', 'volume_name': 'volume-e1322275-82d0-4c3a-9341-d2ae7e34733c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8067445a-2970-4bb2-8d31-9514eba840e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8067445a-2970-4bb2-8d31-9514eba840e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da01a89d-9915-498d-8cca-9390c37da7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:55 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Volume e1322275-82d0-4c3a-9341-d2ae7e34733c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1322275-82d0-4c3a-9341-d2ae7e34733c', 'volume_size': 1} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] creating volume v_e1322275-82d0-4c3a-9341-d2ae7e34733c. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] create volume {'name': 'v_e1322275-82d0-4c3a-9341-d2ae7e34733c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e1322275-82d0-4c3a-9341-d2ae7e34733c', 'is_clone': False, 'name': 'v_e1322275-82d0-4c3a-9341-d2ae7e34733c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da01a89d-9915-498d-8cca-9390c37da7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1322275-82d0-4c3a-9341-d2ae7e34733c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cae4453-a25c-4a19-9fa5-77d4660ec3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:48:56 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Volume volume-e1322275-82d0-4c3a-9341-d2ae7e34733c (e1322275-82d0-4c3a-9341-d2ae7e34733c): created successfully Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cae4453-a25c-4a19-9fa5-77d4660ec3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Flow 'volume_create_manager' (8b44cac5-8552-4692-b6b2-517b4d5d0353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:48:56 user cinder-volume[73579]: INFO cinder.volume.manager [None req-44b1b42f-9a2a-44c7-aae8-71c826843a27 tempest-VolumeQuotasAdminTestJSON-312843163 None] Created volume successfully. Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] atach volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 to target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:57 user cinder-volume[73579]: INFO cinder.volume.manager [None req-874179f9-8bb0-4fb9-9f2f-cc9e9233c85d tempest-VolumeQuotasAdminTestJSON-1259506387 None] Transfer volume completed successfully. Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.coordination [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Acquiring lock "cinder-e1322275-82d0-4c3a-9341-d2ae7e34733c-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.coordination [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Lock "cinder-e1322275-82d0-4c3a-9341-d2ae7e34733c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] remove_export for volume: e1322275-82d0-4c3a-9341-d2ae7e34733c. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1465701619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e1322275-82d0-4c3a-9341-d2ae7e34733c,launched_at=2023-04-14T01:48:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5945c691949444caad1e6f9eeb117c34',provider_auth='CHAP zjUSBTLg CyRktDc6Z9Xsvo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:55Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:48:58Z,updated_at=2023-04-14T01:48:58Z,use_quota=True,user_id='a3d6536812874ed7add95fff04ad0dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] detach volume v_e1322275-82d0-4c3a-9341-d2ae7e34733c from target iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c/luns/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c/luns/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c/luns/v_e1322275-82d0-4c3a-9341-d2ae7e34733c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c/luns/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] failed to remove resource iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c because of JDSS resource v_e1322275-82d0-4c3a-9341-d2ae7e34733c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] delete target: iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] delete target iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3239623162383664', 'lun': 0, 'mode': 'wt', 'name': 'v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'prod_id': 'Storage', 'scsi_id': '29b1b86d8400bd56'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] add credentails to target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] failed to remove resource iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c because of JDSS resource iqn.2010-10.org.openstack:e1322275-82d0-4c3a-9341-d2ae7e34733c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] deleating volume v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] get snapshots for volume v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'name': 'qFBPsMOy'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] initialize_connection for e59663b0-f628-4a16-8c39-38b28a9a8530 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFBPsMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'dc2dbd9a-2e58-44f5-b930-85fc5cf5bb48'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:48:58 user cinder-volume[73579]: INFO cinder.volume.manager [req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c req-fe0c1fd8-b301-4798-9da3-65dc7392e173 tempest-SnapshotDataIntegrityTests-919714320 None] attachment_update completed successfully. Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] get volume v_e1322275-82d0-4c3a-9341-d2ae7e34733c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e1322275-82d0-4c3a-9341-d2ae7e34733c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438344', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110817', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1862593163693922058', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5ce16170612f9278', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292932608', 'san:volume_id': '5ce16170612f9278b90b448f82dc398ec06835fc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83217', 'name': 'v_e1322275-82d0-4c3a-9341-d2ae7e34733c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] delete volume:v_e1322275-82d0-4c3a-9341-d2ae7e34733c recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:48:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1322275-82d0-4c3a-9341-d2ae7e34733c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] volume v_e1322275-82d0-4c3a-9341-d2ae7e34733c deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG cinder.quota [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Created reservations ['55373e83-063b-47c0-8c16-692666309375', 'a55ee535-efce-4fa5-9be5-671305326086', 'b7a582dd-c1f0-413b-b401-b2aef18f76ab', '4f5764cc-1581-4ac9-bdf5-ecfb362108f7'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=62,cinder:UPDATE=33,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:INSERT=8,cinder:SELECT=57,cinder:UPDATE=31,cinder:DELETE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293014528', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:01 user cinder-volume[73579]: DEBUG cinder.manager [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:01 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Deleted volume successfully. Apr 14 01:49:01 user cinder-volume[73579]: DEBUG cinder.coordination [None req-cd0120c8-1806-4b5c-b3bf-f0ee20be4381 tempest-VolumeQuotasAdminTestJSON-1489712374 None] Lock "cinder-e1322275-82d0-4c3a-9341-d2ae7e34733c-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] terminate connection for e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:49:02 user cinder-volume[73579]: INFO cinder.volume.manager [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Terminate volume connection completed successfully. Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Deleting attachment dc2dbd9a-2e58-44f5-b930-85fc5cf5bb48. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: e59663b0-f628-4a16-8c39-38b28a9a8530. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1975546726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e59663b0-f628-4a16-8c39-38b28a9a8530,launched_at=2023-04-14T01:48:52Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP qFBPsMOy v0zSwfYbgL9pMT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:50Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=c240a035-a4c9-4b0f-9e37-04d8aea59cb8,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:49:02Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 from target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Acquiring lock "cinder-ae6f77e9-ea6d-4653-9cd8-5944d88d743d-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-ae6f77e9-ea6d-4653-9cd8-5944d88d743d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] remove_export for volume: ae6f77e9-ea6d-4653-9cd8-5944d88d743d. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-598851587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ae6f77e9-ea6d-4653-9cd8-5944d88d743d,launched_at=2023-04-14T01:46:06Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth='CHAP wdltqivh 4LYapUDdE8GHe1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:05Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:49:03Z,updated_at=2023-04-14T01:49:03Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d from target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d/luns/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] failed to remove resource iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d because of JDSS resource v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] delete target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] delete target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] failed to remove resource iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d because of JDSS resource iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] deleating volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] get snapshots for volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-967ff7f8-4180-4dff-a09f-da17bf15f532 req-49a74ae0-69af-4618-917b-899ac44a06af tempest-SnapshotDataIntegrityTests-919714320 None] target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] get volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438174', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110597', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1120646840974970536', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '50f87c4f5d43163a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292920320', 'san:volume_id': '50f87c4f5d43163abe8e54355e0dc19bb0c40024', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82944', 'name': 'v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] delete volume:v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:49:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] volume v_ae6f77e9-ea6d-4653-9cd8-5944d88d743d deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:49:05 user cinder-volume[73579]: DEBUG cinder.quota [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Created reservations ['c231b16f-bbd4-445f-a5b9-8187f6014233', '56f0b269-41df-452f-93b5-7fa4eaf2a4f3', 'b4546409-ddc2-49ef-a1b1-35958b53c502', '7a606b78-ea2a-42f9-853a-3a47df485a36'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Acquiring lock "cinder-f01988fc-537f-4359-9b58-2a3f4752251b-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-f01988fc-537f-4359-9b58-2a3f4752251b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'available': '114292989952', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.manager [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Deleted volume successfully. Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e0953eff-34f1-4e3f-b5ac-2591027a8b3f tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-ae6f77e9-ea6d-4653-9cd8-5944d88d743d-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] remove_export for volume: f01988fc-537f-4359-9b58-2a3f4752251b. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1093534964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f01988fc-537f-4359-9b58-2a3f4752251b,launched_at=2023-04-14T01:46:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth='CHAP lUEoPgwk KwemOhYAgVRMSH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:49:07Z,updated_at=2023-04-14T01:49:07Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume v_f01988fc-537f-4359-9b58-2a3f4752251b from target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns/v_f01988fc-537f-4359-9b58-2a3f4752251b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b/luns/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] failed to remove resource iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b because of JDSS resource v_f01988fc-537f-4359-9b58-2a3f4752251b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] failed to remove resource iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b because of JDSS resource iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] deleating volume v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] get snapshots for volume v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] get volume v_f01988fc-537f-4359-9b58-2a3f4752251b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f01988fc-537f-4359-9b58-2a3f4752251b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438173', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110593', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10860655725356093014', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c1eb640991852245', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114292989952', 'san:volume_id': 'c1eb64099185224576ae63b50f50af088381014c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81911', 'name': 'v_f01988fc-537f-4359-9b58-2a3f4752251b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] delete volume:v_f01988fc-537f-4359-9b58-2a3f4752251b recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f01988fc-537f-4359-9b58-2a3f4752251b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] volume v_f01988fc-537f-4359-9b58-2a3f4752251b deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.quota [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Created reservations ['1ae4de9c-0236-418b-8cd5-acacddc129df', '9b394107-82cd-4c88-b215-d55378e74b1d', 'f7b3a534-26bb-477f-a96f-b0a55b2d7658', '66c7f430-fed5-424a-803f-9b8cea5c3e4c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293071872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.manager [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Deleted volume successfully. Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-33697197-651b-423d-9b9b-eb35998eb4b5 tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-f01988fc-537f-4359-9b58-2a3f4752251b-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Acquiring lock "cinder-dccc3a21-0674-4347-842b-3d0354dfdfa8-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-dccc3a21-0674-4347-842b-3d0354dfdfa8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] remove_export for volume: dccc3a21-0674-4347-842b-3d0354dfdfa8. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1738533660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=dccc3a21-0674-4347-842b-3d0354dfdfa8,launched_at=2023-04-14T01:46:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7782019f67b04982a58ed5272dc4cbb5',provider_auth='CHAP pnIKHyQa dZFLKjY3abIOl9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:00Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:49:10Z,updated_at=2023-04-14T01:49:10Z,use_quota=True,user_id='c4e5234d2ffe4dc898d22be4bd648c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] detach volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 from target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns/v_dccc3a21-0674-4347-842b-3d0354dfdfa8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8/luns/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] failed to remove resource iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 because of JDSS resource v_dccc3a21-0674-4347-842b-3d0354dfdfa8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] delete target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] failed to remove resource iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 because of JDSS resource iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] deleating volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] get snapshots for volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Flow 'volume_create_manager' (0618a8ef-25e9-428c-85ff-f7ac99dc1754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553be300-22e9-49a1-b3d2-10d0fef7eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553be300-22e9-49a1-b3d2-10d0fef7eacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1190624143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b1446339-0ce8-401e-b2e0-c4811b486a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:49:10Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c8cbdc-46a5-4ae8-9337-6d88a1085d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c8cbdc-46a5-4ae8-9337-6d88a1085d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c5baf6-0c72-447a-8ae6-bd633288c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c5baf6-0c72-447a-8ae6-bd633288c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1446339-0ce8-401e-b2e0-c4811b486a1a', 'volume_name': 'volume-b1446339-0ce8-401e-b2e0-c4811b486a1a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65921710-8ac9-40a2-950c-7cc48a4c5482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65921710-8ac9-40a2-950c-7cc48a4c5482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cfe31b-7154-4007-b539-f27b3cbee749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:10 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Volume b1446339-0ce8-401e-b2e0-c4811b486a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1446339-0ce8-401e-b2e0-c4811b486a1a', 'volume_size': 1} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] creating volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] create volume {'name': 'v_b1446339-0ce8-401e-b2e0-c4811b486a1a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] get volume v_dccc3a21-0674-4347-842b-3d0354dfdfa8 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438171', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '110589', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5554204853898868791', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '20d4758b60b045a4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293071872', 'san:volume_id': '20d4758b60b045a49618636e589aad24f88d5c32', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '80755', 'name': 'v_dccc3a21-0674-4347-842b-3d0354dfdfa8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] delete snapshot v_dccc3a21-0674-4347-842b-3d0354dfdfa8 of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b1446339-0ce8-401e-b2e0-c4811b486a1a', 'is_clone': False, 'name': 'v_b1446339-0ce8-401e-b2e0-c4811b486a1a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cfe31b-7154-4007-b539-f27b3cbee749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1446339-0ce8-401e-b2e0-c4811b486a1a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de708e37-a365-468a-8441-5e62e1f4acac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:11 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Volume volume-b1446339-0ce8-401e-b2e0-c4811b486a1a (b1446339-0ce8-401e-b2e0-c4811b486a1a): created successfully Apr 14 01:49:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de708e37-a365-468a-8441-5e62e1f4acac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Flow 'volume_create_manager' (0618a8ef-25e9-428c-85ff-f7ac99dc1754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:11 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6ace700a-9b15-4507-ab2a-d30867f6721a tempest-ServerActionsTestJSON-2035821517 None] Created volume successfully. Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_dccc3a21-0674-4347-842b-3d0354dfdfa8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] snapshot v_dccc3a21-0674-4347-842b-3d0354dfdfa8 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.quota [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Created reservations ['0e0d800a-7104-48d8-93c4-3cd6816526b3', '81ac74f3-a1df-42cc-b11d-3343afd3ae78', '1be5f967-2bf1-4026-86f4-b47fd7a47550', '090a3f1f-67d5-4ba7-9187-6e22360561d2'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303205376', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.manager [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:12 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Deleted volume successfully. Apr 14 01:49:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7b3b4d09-207c-4c69-accd-66aea3492bd6 tempest-TaggedBootDevicesTest_v242-819739955 None] Lock "cinder-dccc3a21-0674-4347-842b-3d0354dfdfa8-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] create export for volume: b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] ensure volume b1446339-0ce8-401e-b2e0-c4811b486a1a assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] check if targe iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] create target and attach volume b1446339-0ce8-401e-b2e0-c4811b486a1a to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] create target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] atach volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a to target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:49:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] create snapshot 8c494dc1-9b6c-456f-9b65-71233f5e3f85 for volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] cloning v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e to s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] create snapshot s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3936353864386236', 'lun': 0, 'mode': 'wt', 'name': 'v_b1446339-0ce8-401e-b2e0-c4811b486a1a', 'prod_id': 'Storage', 'scsi_id': '9658d8b66a15d5e8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] add credentails to target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'name': 'MbmBcKyr'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] initialize_connection for b1446339-0ce8-401e-b2e0-c4811b486a1a 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:49:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '8d453907-24d9-4a0e-ac93-462f74f5ae5a'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:49:17 user cinder-volume[73579]: INFO cinder.volume.manager [req-703922de-5c24-4d27-80f8-76a0e86b90bb req-a5fb9439-8648-47f9-80c3-b1fe625e0511 tempest-ServerActionsTestJSON-2035821517 None] attachment_update completed successfully. Apr 14 01:49:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_8c494dc1-9b6c-456f-9b65-71233f5e3f85'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] create volume s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 from snapshot s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:49:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e@s_8c494dc1-9b6c-456f-9b65-71233f5e3f85', 'is_clone': True, 'full_name': 'Pool-0/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85', 'name': 's_8c494dc1-9b6c-456f-9b65-71233f5e3f85'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] volume s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:49:19 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=31,cinder:DELETE=4,cinder:SELECT=60,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:19 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=62,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:19 user cinder-volume[73579]: INFO cinder.volume.manager [req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 req-11601a78-675d-4af9-b2fa-86d099098146 tempest-TestVolumeBootPattern-224521177 None] Create snapshot completed successfully Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Acquiring lock "cinder-5c9a8475-2b28-4660-8c4a-197d3b9b2334-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Lock "cinder-5c9a8475-2b28-4660-8c4a-197d3b9b2334-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] remove_export for volume: 5c9a8475-2b28-4660-8c4a-197d3b9b2334. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1206932234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5c9a8475-2b28-4660-8c4a-197d3b9b2334,launched_at=2023-04-14T01:48:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907f632263e04bf2a6c8ff1bae77a5c7',provider_auth='CHAP LvYTVSxj HK5RytnSEP3wFZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:18Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:49:21Z,updated_at=2023-04-14T01:49:21Z,use_quota=True,user_id='236828e284154097a25f59eaedf47c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] detach volume v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 from target iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334/luns/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334/luns/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334/luns/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334/luns/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] failed to remove resource iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 because of JDSS resource v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] delete target: iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] delete target iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] failed to remove resource iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 because of JDSS resource iqn.2010-10.org.openstack:5c9a8475-2b28-4660-8c4a-197d3b9b2334 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] deleating volume v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] get snapshots for volume v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] get volume v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438308', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110767', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2297061554718356186', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3ee78f67c42fbaa0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303160320', 'san:volume_id': '3ee78f67c42fbaa0d38112db220d5ad0ab5426fb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81643', 'name': 'v_5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] delete volume:v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (3dd0295b-990d-43e7-9ee4-9a799f8d9575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7576451-e2b6-4e4b-b8a8-cb22f9e9473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7576451-e2b6-4e4b-b8a8-cb22f9e9473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cc92e1f9-d41a-47d9-abab-eca949db9d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c494dc1-9b6c-456f-9b65-71233f5e3f85,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:49:23Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce67e250-5ff8-4998-970e-d461d3d4439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce67e250-5ff8-4998-970e-d461d3d4439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de550575-6ec5-4849-a2cf-1eefda4a4609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de550575-6ec5-4849-a2cf-1eefda4a4609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'volume_name': 'volume-cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'volume_size': 1, 'snapshot_id': '8c494dc1-9b6c-456f-9b65-71233f5e3f85'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea4d3ef-abcc-443a-8200-0cb0a69fab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea4d3ef-abcc-443a-8200-0cb0a69fab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee769cc-5fde-4ff9-bb1e-daea7e20a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Volume cc92e1f9-d41a-47d9-abab-eca949db9d8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'volume_size': 1, 'snapshot_id': '8c494dc1-9b6c-456f-9b65-71233f5e3f85'} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] create volume cc92e1f9-d41a-47d9-abab-eca949db9d8e from snapshot 8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] cloning s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 to v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] create snapshot v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] terminate connection for b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:49:23 user cinder-volume[73579]: INFO cinder.volume.manager [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Terminate volume connection completed successfully. Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Deleting attachment 8d453907-24d9-4a0e-ac93-462f74f5ae5a. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1190624143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b1446339-0ce8-401e-b2e0-c4811b486a1a,launched_at=2023-04-14T01:49:12Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP MbmBcKyr FYMbrv68h7ApuU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:10Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:49:20Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] detach volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a from target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] volume v_5c9a8475-2b28-4660-8c4a-197d3b9b2334 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.quota [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Created reservations ['482317f3-5886-4ff4-a3f8-0588ead726ca', '2e895788-2854-4825-a30a-ac13cc95b72c', 'd6525c65-89c1-4e13-9d1d-750cd0471456', '6649c1a6-b0a9-40a7-843c-35e5f7e9548e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Acquiring lock "cinder-f9186595-102b-4861-bf47-eda6b312e3a6-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Lock "cinder-f9186595-102b-4861-bf47-eda6b312e3a6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] remove_export for volume: f9186595-102b-4861-bf47-eda6b312e3a6. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1810074306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9186595-102b-4861-bf47-eda6b312e3a6,launched_at=2023-04-14T01:46:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907f632263e04bf2a6c8ff1bae77a5c7',provider_auth='CHAP zdDiwSZI pxZ1qg3JLuGO6y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:46:16Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:49:24Z,updated_at=2023-04-14T01:49:24Z,use_quota=True,user_id='236828e284154097a25f59eaedf47c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] detach volume v_f9186595-102b-4861-bf47-eda6b312e3a6 from target iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6/luns/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6/luns/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6/luns/v_f9186595-102b-4861-bf47-eda6b312e3a6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6/luns/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] failed to remove resource iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 because of JDSS resource v_f9186595-102b-4861-bf47-eda6b312e3a6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] delete target: iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] delete target iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] failed to remove resource iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 because of JDSS resource iqn.2010-10.org.openstack:f9186595-102b-4861-bf47-eda6b312e3a6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] deleating volume v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] get snapshots for volume v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b7c65839-cf57-4b1b-abe7-c69e18073e9d tempest-ServerActionsTestJSON-2035821517 None] target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303242240', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.manager [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Deleted volume successfully. Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2790be98-0172-4805-bb11-927cf0998851 tempest-ServersNegativeTestJSON-1259366012 None] Lock "cinder-5c9a8475-2b28-4660-8c4a-197d3b9b2334-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] get volume v_f9186595-102b-4861-bf47-eda6b312e3a6 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f9186595-102b-4861-bf47-eda6b312e3a6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438185', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110603', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15957968025909557824', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '90d105aac62f85b9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303242240', 'san:volume_id': '90d105aac62f85b99d5dc86e71fb3daa7bf049b7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80765', 'name': 'v_f9186595-102b-4861-bf47-eda6b312e3a6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] delete volume:v_f9186595-102b-4861-bf47-eda6b312e3a6 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Flow 'volume_create_manager' (ed7e1ca1-4d4b-4c82-82cc-3173ad0e0602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4816105-d31b-4075-a780-37f53820ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4816105-d31b-4075-a780-37f53820ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1221527432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=38ffe18d-45f4-4b6f-994a-dace9c1c2840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81229ab998bb4fc0b82cf943480c9ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:49:25Z,use_quota=True,user_id='f3b8e716d00649999b1c39d0d8b48ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e6d4e73-b633-4ab2-b458-dd8411dca24d),volume_type_id=6e6d4e73-b633-4ab2-b458-dd8411dca24d)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1cd545-d61d-43d9-98bc-3e11503c2d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1cd545-d61d-43d9-98bc-3e11503c2d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8b322f-1ef8-48de-b0fb-5990d0c76a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8b322f-1ef8-48de-b0fb-5990d0c76a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'volume_name': 'volume-38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4c365d-0013-464d-a607-58bc61db7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4c365d-0013-464d-a607-58bc61db7039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f40e3a1-1a65-4f6a-a3dd-510657debbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:25 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Volume 38ffe18d-45f4-4b6f-994a-dace9c1c2840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'volume_size': 1} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] creating volume v_38ffe18d-45f4-4b6f-994a-dace9c1c2840. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] create volume {'name': 'v_38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_cc92e1f9-d41a-47d9-abab-eca949db9d8e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] create volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e from snapshot v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] create export for volume: b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] ensure volume b1446339-0ce8-401e-b2e0-c4811b486a1a assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] check if targe iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] create target and attach volume b1446339-0ce8-401e-b2e0-c4811b486a1a to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] create target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85@v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'is_clone': True, 'full_name': 'Pool-0/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'name': 'v_cc92e1f9-d41a-47d9-abab-eca949db9d8e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] get volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85@v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438374', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '110853', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8308070362337454105', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5200cf49c5c5f2c4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303242240', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82863', 'name': 'v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Marking volume cc92e1f9-d41a-47d9-abab-eca949db9d8e as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Copying metadata from snapshot 8c494dc1-9b6c-456f-9b65-71233f5e3f85 to cc92e1f9-d41a-47d9-abab-eca949db9d8e. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'is_clone': False, 'name': 'v_38ffe18d-45f4-4b6f-994a-dace9c1c2840'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f40e3a1-1a65-4f6a-a3dd-510657debbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934398bb-3750-4940-837e-6e2fd14d0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee769cc-5fde-4ff9-bb1e-daea7e20a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'volume_size': 1, 'snapshot_id': '8c494dc1-9b6c-456f-9b65-71233f5e3f85'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2179d601-ea1c-4df2-8576-0c7c25228f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:26 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Volume volume-38ffe18d-45f4-4b6f-994a-dace9c1c2840 (38ffe18d-45f4-4b6f-994a-dace9c1c2840): created successfully Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934398bb-3750-4940-837e-6e2fd14d0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Flow 'volume_create_manager' (ed7e1ca1-4d4b-4c82-82cc-3173ad0e0602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:26 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Volume volume-cc92e1f9-d41a-47d9-abab-eca949db9d8e (cc92e1f9-d41a-47d9-abab-eca949db9d8e): created successfully Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2179d601-ea1c-4df2-8576-0c7c25228f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (3dd0295b-990d-43e7-9ee4-9a799f8d9575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c338f2e4-72cb-4a95-be39-6a5dcf4912a4 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Created volume successfully. Apr 14 01:49:26 user cinder-volume[73579]: INFO cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-b6030cbc-89ed-4a96-922a-05bdbff10085 tempest-TestVolumeBootPattern-224521177 None] Created volume successfully. Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9186595-102b-4861-bf47-eda6b312e3a6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] volume v_f9186595-102b-4861-bf47-eda6b312e3a6 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.quota [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Created reservations ['47902c5a-85b5-4506-9fa2-5628080fa22f', 'e2b75e3c-9d1f-432a-8616-ffefd8b317a5', 'f1827ed8-f898-4093-9253-221ac2347705', '21bf3202-6800-47be-b8ac-c5a5fdfcad4e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=61,cinder:INSERT=16,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:INSERT=16,cinder:UPDATE=27,cinder:DELETE=3,cinder:SELECT=54 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303242240', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.manager [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3c3c0e09-2b7f-4e93-ab95-f7295e510d1a tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Retype volume completed successfully. Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303229952', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.manager [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Deleted volume successfully. Apr 14 01:49:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ced17605-52bb-4d16-95cf-24d3579a55c1 tempest-ServersNegativeTestJSON-1259366012 None] Lock "cinder-f9186595-102b-4861-bf47-eda6b312e3a6-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] atach volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a to target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Acquiring lock "cinder-38ffe18d-45f4-4b6f-994a-dace9c1c2840-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Lock "cinder-38ffe18d-45f4-4b6f-994a-dace9c1c2840-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] remove_export for volume: 38ffe18d-45f4-4b6f-994a-dace9c1c2840. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1221527432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=38ffe18d-45f4-4b6f-994a-dace9c1c2840,launched_at=2023-04-14T01:49:26Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='81229ab998bb4fc0b82cf943480c9ebc',provider_auth='CHAP aJKhfCbm KvAVFgkLZxsG3a',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:25Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:49:29Z,updated_at=2023-04-14T01:49:29Z,use_quota=True,user_id='f3b8e716d00649999b1c39d0d8b48ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bbc7d60-fff3-4ece-9d60-fbcfd4466564),volume_type_id=4bbc7d60-fff3-4ece-9d60-fbcfd4466564) from target:iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] detach volume v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 from target iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840/luns/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840/luns/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840/luns/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840/luns/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] failed to remove resource iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 because of JDSS resource v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] delete target: iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] delete target iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] failed to remove resource iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 because of JDSS resource iqn.2010-10.org.openstack:38ffe18d-45f4-4b6f-994a-dace9c1c2840 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] deleating volume v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] get snapshots for volume v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] create export for volume: cc92e1f9-d41a-47d9-abab-eca949db9d8e. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] ensure volume cc92e1f9-d41a-47d9-abab-eca949db9d8e assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] check if targe iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] create target and attach volume cc92e1f9-d41a-47d9-abab-eca949db9d8e to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] create target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] get volume v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438374', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110856', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4433151865757018068', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1f00177004a57f48', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303229952', 'san:volume_id': '1f00177004a57f48cfcbf569af6194ec96469850', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82874', 'name': 'v_38ffe18d-45f4-4b6f-994a-dace9c1c2840', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] delete volume:v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3936353864386236', 'lun': 0, 'mode': 'wt', 'name': 'v_b1446339-0ce8-401e-b2e0-c4811b486a1a', 'prod_id': 'Storage', 'scsi_id': '9658d8b66a15d5e8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] add credentails to target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'name': 'MbmBcKyr'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] initialize_connection for b1446339-0ce8-401e-b2e0-c4811b486a1a 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:49:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3ce0e3a5-4206-4f9e-b8f7-44479c48a4ef'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:49:30 user cinder-volume[73579]: INFO cinder.volume.manager [req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd req-b332f9b3-216e-43d2-9d00-6c17af23f15f tempest-ServerActionsTestJSON-2035821517 None] attachment_update completed successfully. Apr 14 01:49:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:49:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] volume v_38ffe18d-45f4-4b6f-994a-dace9c1c2840 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:49:31 user cinder-volume[73579]: WARNING cinder.quota [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:49:31 user cinder-volume[73579]: WARNING cinder.quota [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.quota [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Created reservations ['15bd5822-bf5a-48e0-b024-e3be6b057781', 'ff1b9362-8056-4551-880d-074e6b2ac36b', '01d8a047-89da-430c-8bd0-122f92d63965', '3cc9f0ce-844b-4b66-a3ac-281d60906671'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303229952', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Deleted volume successfully. Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1b8e65c1-0105-4aaa-80a9-d6821117b4f5 tempest-VolumeRetypeWithoutMigrationTest-622301617 None] Lock "cinder-38ffe18d-45f4-4b6f-994a-dace9c1c2840-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303311872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] atach volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e to target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:49:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3532303063663439', 'lun': 0, 'mode': 'wt', 'name': 'v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'prod_id': 'Storage', 'scsi_id': '5200cf49c5c5f2c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] add credentails to target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:49:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'name': 'WOKSIlVx'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] initialize_connection for cc92e1f9-d41a-47d9-abab-eca949db9d8e 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:49:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOKSIlVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '89becd1c-3c20-46ef-8267-7db080ef09a2'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:49:34 user cinder-volume[73579]: INFO cinder.volume.manager [req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 req-ec0639ce-efba-47b0-a5fb-776b5b24fd80 tempest-TestVolumeBootPattern-224521177 None] attachment_update completed successfully. Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Flow 'volume_create_manager' (91ea8a2e-f81b-4ea4-9bd1-903a2b55806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b577a9-20b4-48e4-b7ee-aaa24bd0df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b577a9-20b4-48e4-b7ee-aaa24bd0df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-942712117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6763dd9a-e637-4393-9d06-51fb1edc47dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88bb79cd7fe4cec8d0b10b90ea762be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:49:40Z,use_quota=True,user_id='a86fc01591434c35965e0012a2b59915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf47493-b305-4d69-a6a4-f6e8bb7236db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf47493-b305-4d69-a6a4-f6e8bb7236db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d775bf69-2a4f-4f24-91e5-f0c70fbe2976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d775bf69-2a4f-4f24-91e5-f0c70fbe2976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6763dd9a-e637-4393-9d06-51fb1edc47dd', 'volume_name': 'volume-6763dd9a-e637-4393-9d06-51fb1edc47dd', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c33dcf-348e-4c69-8918-6caa7c0bfd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c33dcf-348e-4c69-8918-6caa7c0bfd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e591fd6-dabf-4349-acdd-26b44ac883f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:40 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Volume 6763dd9a-e637-4393-9d06-51fb1edc47dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6763dd9a-e637-4393-9d06-51fb1edc47dd', 'volume_size': 1} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] creating volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] create volume {'name': 'v_6763dd9a-e637-4393-9d06-51fb1edc47dd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6763dd9a-e637-4393-9d06-51fb1edc47dd', 'is_clone': False, 'name': 'v_6763dd9a-e637-4393-9d06-51fb1edc47dd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e591fd6-dabf-4349-acdd-26b44ac883f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6763dd9a-e637-4393-9d06-51fb1edc47dd', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592a91de-5fae-4e43-954d-8c2864ac4399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:41 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Volume volume-6763dd9a-e637-4393-9d06-51fb1edc47dd (6763dd9a-e637-4393-9d06-51fb1edc47dd): created successfully Apr 14 01:49:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592a91de-5fae-4e43-954d-8c2864ac4399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Flow 'volume_create_manager' (91ea8a2e-f81b-4ea4-9bd1-903a2b55806b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:41 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5f3b5cb3-23ab-4c28-87a3-1f73fd3e9317 tempest-VolumesDeleteCascade-1074396724 None] Created volume successfully. Apr 14 01:49:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] create snapshot 831a6e4f-d9a2-46ad-9449-dd3b9dc17fce for volume 6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:49:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] cloning v_6763dd9a-e637-4393-9d06-51fb1edc47dd to s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:49:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] create snapshot s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:49:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] create volume s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce from snapshot s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:49:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6763dd9a-e637-4393-9d06-51fb1edc47dd@s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce', 'is_clone': True, 'full_name': 'Pool-0/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce', 'name': 's_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] volume s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:49:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f0783417-2e6b-4c41-b835-573fdb64939f tempest-VolumesDeleteCascade-1074396724 None] Create snapshot completed successfully Apr 14 01:49:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] create snapshot 8baa7581-8334-49af-a38f-22be655dfc6a for volume 6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:49:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] cloning v_6763dd9a-e637-4393-9d06-51fb1edc47dd to s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:49:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] create snapshot s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:49:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_8baa7581-8334-49af-a38f-22be655dfc6a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] create volume s_8baa7581-8334-49af-a38f-22be655dfc6a from snapshot s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:49:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6763dd9a-e637-4393-9d06-51fb1edc47dd@s_8baa7581-8334-49af-a38f-22be655dfc6a', 'is_clone': True, 'full_name': 'Pool-0/s_8baa7581-8334-49af-a38f-22be655dfc6a', 'name': 's_8baa7581-8334-49af-a38f-22be655dfc6a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] volume s_8baa7581-8334-49af-a38f-22be655dfc6a properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:49:47 user cinder-volume[73579]: INFO cinder.volume.manager [None req-72ab51b3-304d-4228-b923-de36edd03dea tempest-VolumesDeleteCascade-1074396724 None] Create snapshot completed successfully Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Acquiring lock "cinder-6763dd9a-e637-4393-9d06-51fb1edc47dd-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-6763dd9a-e637-4393-9d06-51fb1edc47dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] remove_export for volume: 6763dd9a-e637-4393-9d06-51fb1edc47dd. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-942712117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6763dd9a-e637-4393-9d06-51fb1edc47dd,launched_at=2023-04-14T01:49:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88bb79cd7fe4cec8d0b10b90ea762be',provider_auth='CHAP VvzGfUDH XiEHGjgI2v5M9K',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:40Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:49:48Z,updated_at=2023-04-14T01:49:48Z,use_quota=True,user_id='a86fc01591434c35965e0012a2b59915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] detach volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd from target iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd/luns/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd/luns/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd/luns/v_6763dd9a-e637-4393-9d06-51fb1edc47dd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd/luns/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] failed to remove resource iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd because of JDSS resource v_6763dd9a-e637-4393-9d06-51fb1edc47dd DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] delete target: iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] delete target iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] failed to remove resource iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd because of JDSS resource iqn.2010-10.org.openstack:6763dd9a-e637-4393-9d06-51fb1edc47dd DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Performing cascade delete. {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Acquiring lock "cinder-831a6e4f-d9a2-46ad-9449-dd3b9dc17fce-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-831a6e4f-d9a2-46ad-9449-dd3b9dc17fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] deleating snapshot s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] get volume s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6763dd9a-e637-4393-9d06-51fb1edc47dd@s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438393', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110878', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11140289597077202284', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '83bba590a3a4f798', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303180800', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82032', 'name': 's_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] delete snapshot s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce of volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Flow 'volume_create_manager' (ba70dc46-b9a0-4be8-84ea-58e3671a7ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c8942f-9c7f-49bb-af2c-c0eea98b3693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c8942f-9c7f-49bb-af2c-c0eea98b3693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1083519269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3de04739384e3ea3a475fee28be3c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:49:50Z,use_quota=True,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5083c8-dfea-4404-a310-b84c7783d2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5083c8-dfea-4404-a310-b84c7783d2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a0a103-66c8-4460-8979-977ea076edb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a0a103-66c8-4460-8979-977ea076edb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'volume_name': 'volume-8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51779b0-a689-4f50-bc0f-1c855e0976ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51779b0-a689-4f50-bc0f-1c855e0976ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759f0724-4769-46e3-8cc2-0e71057c3025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:50 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Volume 8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'volume_size': 1} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] creating volume v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] create volume {'name': 'v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots/s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] snapshot s_831a6e4f-d9a2-46ad-9449-dd3b9dc17fce deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.quota [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Created reservations ['4526d1a5-2f9a-47c0-a2d1-f92bb8cd18c8', '5920d8cf-8727-4940-816d-2cdfb0b69dd3', '98ec06ae-2946-440b-aed9-f0460042ef79', '6a91139a-41f3-4da6-8779-0aa94e37a2d6'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=33,cinder:SELECT=58,cinder:DELETE=3,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Delete snapshot completed successfully. Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-831a6e4f-d9a2-46ad-9449-dd3b9dc17fce-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Acquiring lock "cinder-8baa7581-8334-49af-a38f-22be655dfc6a-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-8baa7581-8334-49af-a38f-22be655dfc6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] deleating snapshot s_8baa7581-8334-49af-a38f-22be655dfc6a. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] get volume s_8baa7581-8334-49af-a38f-22be655dfc6a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6763dd9a-e637-4393-9d06-51fb1edc47dd@s_8baa7581-8334-49af-a38f-22be655dfc6a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_8baa7581-8334-49af-a38f-22be655dfc6a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438396', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110884', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10553401767704971791', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '68d976da366bef8b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303123456', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82761', 'name': 's_8baa7581-8334-49af-a38f-22be655dfc6a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] delete snapshot s_8baa7581-8334-49af-a38f-22be655dfc6a of volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots/s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots/s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'is_clone': False, 'name': 'v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759f0724-4769-46e3-8cc2-0e71057c3025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e06252-1827-48e9-859b-b70a1b475b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:51 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Volume volume-8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b (8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b): created successfully Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e06252-1827-48e9-859b-b70a1b475b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Flow 'volume_create_manager' (ba70dc46-b9a0-4be8-84ea-58e3671a7ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:51 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7452d066-54db-48b6-8dab-4a0b61fc9345 tempest-ServerRescueNegativeTestJSON-1453869246 None] Created volume successfully. Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots/s_8baa7581-8334-49af-a38f-22be655dfc6a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] snapshot s_8baa7581-8334-49af-a38f-22be655dfc6a deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=76,cinder:UPDATE=20,cinder:INSERT=2,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (3024cde2-1c3d-4326-bca3-309c2b4f7d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186803ad-9254-41b8-b443-2298944d0f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186803ad-9254-41b8-b443-2298944d0f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1127664140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4044000e-5f2c-4303-b69d-07287f59fbcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df31f8b5-2c54-4c92-ae47-c7b937f994fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:49:53Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecca84d8-5984-45a6-8a4a-572a1f2e15df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecca84d8-5984-45a6-8a4a-572a1f2e15df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90fc74d-3576-483c-88a9-f7c7f0d89e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90fc74d-3576-483c-88a9-f7c7f0d89e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4044000e-5f2c-4303-b69d-07287f59fbcb', 'volume_name': 'volume-4044000e-5f2c-4303-b69d-07287f59fbcb', 'volume_size': 1, 'snapshot_id': 'df31f8b5-2c54-4c92-ae47-c7b937f994fb'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a85b057-1b64-40ae-bbc0-69654d9e4d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a85b057-1b64-40ae-bbc0-69654d9e4d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6a537d-b370-45ba-b78d-2354561ae580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:52 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Volume 4044000e-5f2c-4303-b69d-07287f59fbcb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4044000e-5f2c-4303-b69d-07287f59fbcb', 'volume_size': 1, 'snapshot_id': 'df31f8b5-2c54-4c92-ae47-c7b937f994fb'} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] create volume 4044000e-5f2c-4303-b69d-07287f59fbcb from snapshot df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] cloning s_df31f8b5-2c54-4c92-ae47-c7b937f994fb to v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.quota [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Created reservations ['6039cc3d-4d9d-43de-ae26-e668f109de97', 'f94f4dbc-382f-4293-95b0-f835b4cc4a4b', '9ab947e4-4623-4456-b447-107113dadb39', '6bf729f4-fa90-4182-b946-a26c6baa1b08'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:52 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Delete snapshot completed successfully. Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-8baa7581-8334-49af-a38f-22be655dfc6a-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Snapshots deleted, issuing volume delete {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] deleating volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] get volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6763dd9a-e637-4393-9d06-51fb1edc47dd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438390', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110872', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9208844234041296877', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e95d61219278af2d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302844928', 'san:volume_id': 'e95d61219278af2d5422f2b924b2b8d9de7a3633', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82024', 'name': 'v_6763dd9a-e637-4393-9d06-51fb1edc47dd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] delete volume:v_6763dd9a-e637-4393-9d06-51fb1edc47dd recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_4044000e-5f2c-4303-b69d-07287f59fbcb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] create volume v_4044000e-5f2c-4303-b69d-07287f59fbcb from snapshot v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb@v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'is_clone': True, 'full_name': 'Pool-0/v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'name': 'v_4044000e-5f2c-4303-b69d-07287f59fbcb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] get volume v_4044000e-5f2c-4303-b69d-07287f59fbcb info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb@v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438403', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '110903', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7256988606589412216', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1494292288ef4779', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302881792', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83267', 'name': 'v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6a537d-b370-45ba-b78d-2354561ae580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4044000e-5f2c-4303-b69d-07287f59fbcb', 'volume_size': 1, 'snapshot_id': 'df31f8b5-2c54-4c92-ae47-c7b937f994fb'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1314e814-521c-4dbd-9b83-1d313637de28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:54 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Volume volume-4044000e-5f2c-4303-b69d-07287f59fbcb (4044000e-5f2c-4303-b69d-07287f59fbcb): created successfully Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1314e814-521c-4dbd-9b83-1d313637de28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (3024cde2-1c3d-4326-bca3-309c2b4f7d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:54 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ede92cd8-3a53-4a0c-84d6-7eb8455fdae6 tempest-SnapshotDataIntegrityTests-919714320 None] Created volume successfully. Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6763dd9a-e637-4393-9d06-51fb1edc47dd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] volume v_6763dd9a-e637-4393-9d06-51fb1edc47dd deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.quota [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Created reservations ['0fe37cf6-c474-4df9-a79d-0f6198981323', 'c096e288-d58b-4818-936c-eef6af896f15', '81700d2a-5529-4bce-9e4f-2b91ea44b4e5', '85304d4a-542e-4cc9-b6df-47778e570a83'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'available': '114302869504', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.manager [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:49:55 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Deleted volume successfully. Apr 14 01:49:55 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4ca3c227-937a-4226-9ed8-cd915a64e001 tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-6763dd9a-e637-4393-9d06-51fb1edc47dd-delete_volume" released by "delete_volume" :: held 7.769s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Flow 'volume_create_manager' (019f1ee7-9fa6-4f81-8ba8-a5edcfbf73ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaed776d-f179-446b-be38-962735c2ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaed776d-f179-446b-be38-962735c2ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-27044533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8428d2ad-6dab-477b-8938-b80ed0947b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88bb79cd7fe4cec8d0b10b90ea762be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:49:56Z,use_quota=True,user_id='a86fc01591434c35965e0012a2b59915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b71f82c-24b6-4477-a6c5-37baf9ff8b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b71f82c-24b6-4477-a6c5-37baf9ff8b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91b6cd9-242d-41a2-9a58-0a02a418b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91b6cd9-242d-41a2-9a58-0a02a418b2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8428d2ad-6dab-477b-8938-b80ed0947b72', 'volume_name': 'volume-8428d2ad-6dab-477b-8938-b80ed0947b72', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32936d01-7ccb-4e86-aee8-eb5d5a3db2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32936d01-7ccb-4e86-aee8-eb5d5a3db2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b4ed6b-337e-432e-aadd-8d0fdc43ed11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:56 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Volume 8428d2ad-6dab-477b-8938-b80ed0947b72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8428d2ad-6dab-477b-8938-b80ed0947b72', 'volume_size': 1} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] creating volume v_8428d2ad-6dab-477b-8938-b80ed0947b72. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] create volume {'name': 'v_8428d2ad-6dab-477b-8938-b80ed0947b72', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] create export for volume: 4044000e-5f2c-4303-b69d-07287f59fbcb. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] ensure volume 4044000e-5f2c-4303-b69d-07287f59fbcb assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] check if targe iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] create target and attach volume 4044000e-5f2c-4303-b69d-07287f59fbcb to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] create target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8428d2ad-6dab-477b-8938-b80ed0947b72', 'is_clone': False, 'name': 'v_8428d2ad-6dab-477b-8938-b80ed0947b72'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b4ed6b-337e-432e-aadd-8d0fdc43ed11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8428d2ad-6dab-477b-8938-b80ed0947b72', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b93dd2-1059-4177-84fb-897392f0cc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:49:57 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Volume volume-8428d2ad-6dab-477b-8938-b80ed0947b72 (8428d2ad-6dab-477b-8938-b80ed0947b72): created successfully Apr 14 01:49:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b93dd2-1059-4177-84fb-897392f0cc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:49:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Flow 'volume_create_manager' (019f1ee7-9fa6-4f81-8ba8-a5edcfbf73ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:49:57 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9cbcec36-7d7b-4bbb-8f28-06ab65812608 tempest-VolumesDeleteCascade-1074396724 None] Created volume successfully. Apr 14 01:49:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] create snapshot e921996b-df7f-485a-a38f-f0f5e6efb954 for volume 8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:49:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] cloning v_8428d2ad-6dab-477b-8938-b80ed0947b72 to s_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:49:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] create snapshot s_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:49:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e921996b-df7f-485a-a38f-f0f5e6efb954'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] create volume s_e921996b-df7f-485a-a38f-f0f5e6efb954 from snapshot s_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] atach volume v_4044000e-5f2c-4303-b69d-07287f59fbcb to target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:49:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8428d2ad-6dab-477b-8938-b80ed0947b72@s_e921996b-df7f-485a-a38f-f0f5e6efb954', 'is_clone': True, 'full_name': 'Pool-0/s_e921996b-df7f-485a-a38f-f0f5e6efb954', 'name': 's_e921996b-df7f-485a-a38f-f0f5e6efb954'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] volume s_e921996b-df7f-485a-a38f-f0f5e6efb954 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:50:00 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9fee60a3-2ab0-4070-baef-81de4515fa84 tempest-VolumesDeleteCascade-1074396724 None] Create snapshot completed successfully Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Flow 'volume_create_manager' (7a27a04c-0bed-4e7e-b602-c6b6c34e92ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d89d85-7642-40f5-aa23-ae46f9be875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d89d85-7642-40f5-aa23-ae46f9be875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1956686512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ae78731a-c889-4c44-842d-084aac30d2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88bb79cd7fe4cec8d0b10b90ea762be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e921996b-df7f-485a-a38f-f0f5e6efb954,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:50:01Z,use_quota=True,user_id='a86fc01591434c35965e0012a2b59915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918fec80-0a71-412d-a8ee-225be164977c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918fec80-0a71-412d-a8ee-225be164977c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd9f271-138b-4492-9414-e32c8dbdbdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd9f271-138b-4492-9414-e32c8dbdbdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae78731a-c889-4c44-842d-084aac30d2a7', 'volume_name': 'volume-ae78731a-c889-4c44-842d-084aac30d2a7', 'volume_size': 1, 'snapshot_id': 'e921996b-df7f-485a-a38f-f0f5e6efb954'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8013fa5-c03c-453b-91c5-17c941db9c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8013fa5-c03c-453b-91c5-17c941db9c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adce8fdd-e8c6-4885-bd24-6c0b1619f2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:01 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Volume ae78731a-c889-4c44-842d-084aac30d2a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae78731a-c889-4c44-842d-084aac30d2a7', 'volume_size': 1, 'snapshot_id': 'e921996b-df7f-485a-a38f-f0f5e6efb954'} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] create volume ae78731a-c889-4c44-842d-084aac30d2a7 from snapshot e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] cloning s_e921996b-df7f-485a-a38f-f0f5e6efb954 to v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] create snapshot v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3134393432393232', 'lun': 0, 'mode': 'wt', 'name': 'v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'prod_id': 'Storage', 'scsi_id': '1494292288ef4779'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] add credentails to target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'name': 'BOyRmVdS'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] initialize_connection for 4044000e-5f2c-4303-b69d-07287f59fbcb 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:50:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOyRmVdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '967263ef-a6dc-4107-a299-c43bda15b494'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:50:01 user cinder-volume[73579]: INFO cinder.volume.manager [req-588a3e7c-c239-4ffd-8689-4af9adf06195 req-658dc470-ce30-454c-90d1-77f8ba27f2d3 tempest-SnapshotDataIntegrityTests-919714320 None] attachment_update completed successfully. Apr 14 01:50:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_ae78731a-c889-4c44-842d-084aac30d2a7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] create volume v_ae78731a-c889-4c44-842d-084aac30d2a7 from snapshot v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:50:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_e921996b-df7f-485a-a38f-f0f5e6efb954@v_ae78731a-c889-4c44-842d-084aac30d2a7', 'is_clone': True, 'full_name': 'Pool-0/v_ae78731a-c889-4c44-842d-084aac30d2a7', 'name': 'v_ae78731a-c889-4c44-842d-084aac30d2a7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] get volume v_ae78731a-c889-4c44-842d-084aac30d2a7 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_e921996b-df7f-485a-a38f-f0f5e6efb954@v_ae78731a-c889-4c44-842d-084aac30d2a7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ae78731a-c889-4c44-842d-084aac30d2a7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438412', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110924', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17622388480003164374', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '446f736bd803d061', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302750720', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83014', 'name': 'v_ae78731a-c889-4c44-842d-084aac30d2a7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adce8fdd-e8c6-4885-bd24-6c0b1619f2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae78731a-c889-4c44-842d-084aac30d2a7', 'volume_size': 1, 'snapshot_id': 'e921996b-df7f-485a-a38f-f0f5e6efb954'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485074ae-f9fd-439b-9895-50e4c5a6ad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Volume volume-ae78731a-c889-4c44-842d-084aac30d2a7 (ae78731a-c889-4c44-842d-084aac30d2a7): created successfully Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485074ae-f9fd-439b-9895-50e4c5a6ad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Flow 'volume_create_manager' (7a27a04c-0bed-4e7e-b602-c6b6c34e92ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c22c643d-c1a4-4db5-b1f7-64a15697ace3 tempest-VolumesDeleteCascade-1074396724 None] Created volume successfully. Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Acquiring lock "cinder-8428d2ad-6dab-477b-8938-b80ed0947b72-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-8428d2ad-6dab-477b-8938-b80ed0947b72-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=70,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] remove_export for volume: 8428d2ad-6dab-477b-8938-b80ed0947b72. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-27044533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8428d2ad-6dab-477b-8938-b80ed0947b72,launched_at=2023-04-14T01:49:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88bb79cd7fe4cec8d0b10b90ea762be',provider_auth='CHAP OrQdaXDv IRQd0egf7zTjbc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:56Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:50:04Z,updated_at=2023-04-14T01:50:04Z,use_quota=True,user_id='a86fc01591434c35965e0012a2b59915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] detach volume v_8428d2ad-6dab-477b-8938-b80ed0947b72 from target iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72/luns/v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72/luns/v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72/luns/v_8428d2ad-6dab-477b-8938-b80ed0947b72'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72/luns/v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] failed to remove resource iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 because of JDSS resource v_8428d2ad-6dab-477b-8938-b80ed0947b72 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] delete target: iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] delete target iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] failed to remove resource iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 because of JDSS resource iqn.2010-10.org.openstack:8428d2ad-6dab-477b-8938-b80ed0947b72 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Performing cascade delete. {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Acquiring lock "cinder-e921996b-df7f-485a-a38f-f0f5e6efb954-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-e921996b-df7f-485a-a38f-f0f5e6efb954-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] deleating snapshot s_e921996b-df7f-485a-a38f-f0f5e6efb954. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume s_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 04:13:31', 'volsize': '1073741824', 'createtxg': '110923', 'guid': '8366124017657713536', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_ae78731a-c889-4c44-842d-084aac30d2a7', 'objsetid': '83008', 'name': 'v_ae78731a-c889-4c44-842d-084aac30d2a7', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] terminate connection for 4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:50:05 user cinder-volume[73579]: INFO cinder.volume.manager [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Terminate volume connection completed successfully. Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Deleting attachment 967263ef-a6dc-4107-a299-c43bda15b494. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: 4044000e-5f2c-4303-b69d-07287f59fbcb. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1127664140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4044000e-5f2c-4303-b69d-07287f59fbcb,launched_at=2023-04-14T01:49:55Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP BOyRmVdS xbdGEzmKYTX7u2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:53Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=df31f8b5-2c54-4c92-ae47-c7b937f994fb,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:50:05Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_4044000e-5f2c-4303-b69d-07287f59fbcb from target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] volume s_e921996b-df7f-485a-a38f-f0f5e6efb954 updated {{(pid=73579) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.quota [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Created reservations ['03e9128d-d81a-456f-aef9-14fdb78c8534', '35ce3bbb-b698-4b59-aa5b-71f6239345c8', '8edbd328-292e-48fe-9b8f-649014247e5c', '483573e6-167d-451d-9333-396d9422e83e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:50:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Delete snapshot completed successfully. Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-e921996b-df7f-485a-a38f-f0f5e6efb954-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Snapshots deleted, issuing volume delete {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] deleating volume v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3996b91f-e623-42b9-bd74-d783d898af00 req-60952b0f-b85e-450b-abec-3c692ca6877f tempest-SnapshotDataIntegrityTests-919714320 None] target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 04:13:28', 'volsize': '1073741824', 'createtxg': '110913', 'guid': '12172048046964976954', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_e921996b-df7f-485a-a38f-f0f5e6efb954', 'objsetid': '82198', 'name': 's_e921996b-df7f-485a-a38f-f0f5e6efb954', 'defer_destroy': 'off', 'san:volume_id': '31ff4067dd2bbb4f6b14d84a81aed071129484c1', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] volume v_8428d2ad-6dab-477b-8938-b80ed0947b72 updated {{(pid=73579) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG cinder.quota [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Created reservations ['a64beddf-f616-485f-a595-5089e7ca6b07', '0158ca87-2831-4310-8de4-5f51034c429f', '7875f137-0780-4e4b-8055-1b6dca4523dd', '1dce7b75-954f-4b77-8d5f-78e731796f45'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=36,cinder:SELECT=57,cinder:DELETE=4,cinder:INSERT=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'available': '114302619648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.manager [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:50:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Deleted volume successfully. Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-70b01ea5-043d-44a7-b4e6-bdccc1de369d tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-8428d2ad-6dab-477b-8938-b80ed0947b72-delete_volume" released by "delete_volume" :: held 5.291s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Acquiring lock "cinder-ae78731a-c889-4c44-842d-084aac30d2a7-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-ae78731a-c889-4c44-842d-084aac30d2a7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] remove_export for volume: ae78731a-c889-4c44-842d-084aac30d2a7. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1956686512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ae78731a-c889-4c44-842d-084aac30d2a7,launched_at=2023-04-14T01:50:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88bb79cd7fe4cec8d0b10b90ea762be',provider_auth='CHAP yzZnOVuY kUJ5p1TZLsazVN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:01Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=e921996b-df7f-485a-a38f-f0f5e6efb954,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:50:10Z,updated_at=2023-04-14T01:50:10Z,use_quota=True,user_id='a86fc01591434c35965e0012a2b59915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] detach volume v_ae78731a-c889-4c44-842d-084aac30d2a7 from target iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7/luns/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7/luns/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7/luns/v_ae78731a-c889-4c44-842d-084aac30d2a7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7/luns/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] failed to remove resource iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 because of JDSS resource v_ae78731a-c889-4c44-842d-084aac30d2a7 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] delete target: iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] delete target iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] failed to remove resource iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 because of JDSS resource iqn.2010-10.org.openstack:ae78731a-c889-4c44-842d-084aac30d2a7 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] deleating volume v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] get volume v_ae78731a-c889-4c44-842d-084aac30d2a7 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_e921996b-df7f-485a-a38f-f0f5e6efb954@v_ae78731a-c889-4c44-842d-084aac30d2a7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ae78731a-c889-4c44-842d-084aac30d2a7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438412', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110924', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17622388480003164374', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '446f736bd803d061', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302619648', 'san:volume_id': '446f736bd803d06106c3241c837ec9ae0176f934', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83014', 'name': 'v_ae78731a-c889-4c44-842d-084aac30d2a7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae78731a-c889-4c44-842d-084aac30d2a7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume t_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 04:13:31', 'volsize': '1073741824', 'createtxg': '110923', 'guid': '8366124017657713536', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_ae78731a-c889-4c44-842d-084aac30d2a7', 'objsetid': '83008', 'name': 'v_ae78731a-c889-4c44-842d-084aac30d2a7', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e921996b-df7f-485a-a38f-f0f5e6efb954/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] get volume t_e921996b-df7f-485a-a38f-f0f5e6efb954 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_8428d2ad-6dab-477b-8938-b80ed0947b72@s_e921996b-df7f-485a-a38f-f0f5e6efb954', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_e921996b-df7f-485a-a38f-f0f5e6efb954', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438409', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110914', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12519517484728329955', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ecbfe7e7d41e09a5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302619648', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82997', 'name': 't_e921996b-df7f-485a-a38f-f0f5e6efb954', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e921996b-df7f-485a-a38f-f0f5e6efb954 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] get snapshots for volume t_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 04:13:28', 'volsize': '1073741824', 'createtxg': '110913', 'guid': '12172048046964976954', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_e921996b-df7f-485a-a38f-f0f5e6efb954', 'objsetid': '82198', 'name': 's_e921996b-df7f-485a-a38f-f0f5e6efb954', 'defer_destroy': 'off', 'san:volume_id': '31ff4067dd2bbb4f6b14d84a81aed071129484c1', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] get volume t_8428d2ad-6dab-477b-8938-b80ed0947b72 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_8428d2ad-6dab-477b-8938-b80ed0947b72', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438406', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110908', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8478989890245563017', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '31ff4067dd2bbb4f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302619648', 'san:volume_id': '31ff4067dd2bbb4f6b14d84a81aed071129484c1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83281', 'name': 't_8428d2ad-6dab-477b-8938-b80ed0947b72', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] delete volume:t_8428d2ad-6dab-477b-8938-b80ed0947b72 recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_8428d2ad-6dab-477b-8938-b80ed0947b72 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Lock "cinder-ae78731a-c889-4c44-842d-084aac30d2a7-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server [None req-10c238d5-c3a9-45d3-ae1f-e2a0f55d514d tempest-VolumesDeleteCascade-1074396724 None] Exception during message handling: KeyError: 'errno' Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 369, in _delete_back_recursively Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self._delete_back_recursively( Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 01:50:12 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server Apr 14 01:50:15 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:50:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Flow 'volume_create_manager' (b39338fe-a9d1-4724-b0c5-3d7ae66830c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da79969c-a5be-47cb-a24f-ef2e17de5e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da79969c-a5be-47cb-a24f-ef2e17de5e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469914781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8b4c045d-872d-4682-989e-4b75043840bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2169d9e633e34d76b0abac86e068d4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:50:16Z,use_quota=True,user_id='352c2ca2a1264d50a06b5153a31d9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62a06e-d23f-4cc8-92d7-bf08b4454208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62a06e-d23f-4cc8-92d7-bf08b4454208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28a2a6f-4392-4b1c-bdeb-c4000745fea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28a2a6f-4392-4b1c-bdeb-c4000745fea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4c045d-872d-4682-989e-4b75043840bf', 'volume_name': 'volume-8b4c045d-872d-4682-989e-4b75043840bf', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1701e2ee-8abb-4ee1-b428-b0089f7253bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1701e2ee-8abb-4ee1-b428-b0089f7253bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db23e7e7-a711-4fd5-8dd3-d84c1c75fae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:16 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Volume 8b4c045d-872d-4682-989e-4b75043840bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4c045d-872d-4682-989e-4b75043840bf', 'volume_size': 1} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] creating volume v_8b4c045d-872d-4682-989e-4b75043840bf. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] create volume {'name': 'v_8b4c045d-872d-4682-989e-4b75043840bf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8b4c045d-872d-4682-989e-4b75043840bf', 'is_clone': False, 'name': 'v_8b4c045d-872d-4682-989e-4b75043840bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db23e7e7-a711-4fd5-8dd3-d84c1c75fae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4c045d-872d-4682-989e-4b75043840bf', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b058b5-89a0-4361-9146-76facdb48f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:16 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Volume volume-8b4c045d-872d-4682-989e-4b75043840bf (8b4c045d-872d-4682-989e-4b75043840bf): created successfully Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b058b5-89a0-4361-9146-76facdb48f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Flow 'volume_create_manager' (b39338fe-a9d1-4724-b0c5-3d7ae66830c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-96e946e1-1ae1-479f-a61e-ed42278bd3c8 tempest-VolumesTransfersV355Test-1266740839 None] Created volume successfully. Apr 14 01:50:17 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8071aa8e-5bef-42dd-adc2-d7e2431c85db tempest-VolumesTransfersV355Test-652403679 None] Transfer volume completed successfully. Apr 14 01:50:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Acquiring lock "cinder-8b4c045d-872d-4682-989e-4b75043840bf-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:50:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Lock "cinder-8b4c045d-872d-4682-989e-4b75043840bf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] remove_export for volume: 8b4c045d-872d-4682-989e-4b75043840bf. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469914781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8b4c045d-872d-4682-989e-4b75043840bf,launched_at=2023-04-14T01:50:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ce213e3bc84ac28add1e70f16c890d',provider_auth='CHAP RIKcjUQz JQkztd3hrOgZPj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:16Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:50:18Z,updated_at=2023-04-14T01:50:18Z,use_quota=True,user_id='04a35f7fb9d64073a45f655603158295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] detach volume v_8b4c045d-872d-4682-989e-4b75043840bf from target iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf/luns/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf/luns/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf/luns/v_8b4c045d-872d-4682-989e-4b75043840bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf/luns/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] failed to remove resource iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf because of JDSS resource v_8b4c045d-872d-4682-989e-4b75043840bf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] delete target: iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] delete target iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] failed to remove resource iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf because of JDSS resource iqn.2010-10.org.openstack:8b4c045d-872d-4682-989e-4b75043840bf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] deleating volume v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] get snapshots for volume v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] get volume v_8b4c045d-872d-4682-989e-4b75043840bf info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8b4c045d-872d-4682-989e-4b75043840bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438425', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110937', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6951105167133888630', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '74468f95dd73cecf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302525440', 'san:volume_id': '74468f95dd73cecf752c6bc52b0a243c5ce89733', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82043', 'name': 'v_8b4c045d-872d-4682-989e-4b75043840bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] delete volume:v_8b4c045d-872d-4682-989e-4b75043840bf recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b4c045d-872d-4682-989e-4b75043840bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] volume v_8b4c045d-872d-4682-989e-4b75043840bf deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:50:20 user cinder-volume[73579]: DEBUG cinder.quota [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Created reservations ['af0cd9bd-4418-4200-802b-8a562417a0a5', '5ea1837c-d6d4-4fc8-bd82-7af565c4dd9f', '67efeee4-650b-4d2f-be4b-9d1f2980f8ab', '07628dff-cff7-47ed-8438-1524cc690e3c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:50:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:50:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:50:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 200, 'error': None, 'data': {'available': '114302607360', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.manager [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:50:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Deleted volume successfully. Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-97c4a4ca-1259-478b-8cb3-ad268c0680e0 tempest-VolumesTransfersV355Test-942460041 None] Lock "cinder-8b4c045d-872d-4682-989e-4b75043840bf-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Flow 'volume_create_manager' (c3b35f80-527d-4e0f-b3ae-24b8c4a9d819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc45d83-0ad6-43a7-8745-426295f264d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc45d83-0ad6-43a7-8745-426295f264d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667648628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=add5f919-9b3c-4fbe-883b-daf9f076dc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2169d9e633e34d76b0abac86e068d4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:50:22Z,use_quota=True,user_id='352c2ca2a1264d50a06b5153a31d9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd9f330-9360-495c-ad24-dc25b495ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd9f330-9360-495c-ad24-dc25b495ae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df67d308-eb5a-4028-b0fe-6c050d200de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df67d308-eb5a-4028-b0fe-6c050d200de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'volume_name': 'volume-add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed25c3f-4a63-4dcf-85cf-e3f9f4a938fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed25c3f-4a63-4dcf-85cf-e3f9f4a938fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b6a862-bebf-4d55-aa8a-21118ac70c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:21 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Volume add5f919-9b3c-4fbe-883b-daf9f076dc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'volume_size': 1} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] creating volume v_add5f919-9b3c-4fbe-883b-daf9f076dc3f. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] create volume {'name': 'v_add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'is_clone': False, 'name': 'v_add5f919-9b3c-4fbe-883b-daf9f076dc3f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b6a862-bebf-4d55-aa8a-21118ac70c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8492fae-ec61-430f-bb67-1fff9111f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:22 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Volume volume-add5f919-9b3c-4fbe-883b-daf9f076dc3f (add5f919-9b3c-4fbe-883b-daf9f076dc3f): created successfully Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8492fae-ec61-430f-bb67-1fff9111f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Flow 'volume_create_manager' (c3b35f80-527d-4e0f-b3ae-24b8c4a9d819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-37c26090-13f0-4bfb-ac6f-5b1a9f6af891 tempest-VolumesTransfersV355Test-1266740839 None] Created volume successfully. Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Acquiring lock "cinder-add5f919-9b3c-4fbe-883b-daf9f076dc3f-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Lock "cinder-add5f919-9b3c-4fbe-883b-daf9f076dc3f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] remove_export for volume: add5f919-9b3c-4fbe-883b-daf9f076dc3f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667648628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=add5f919-9b3c-4fbe-883b-daf9f076dc3f,launched_at=2023-04-14T01:50:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2169d9e633e34d76b0abac86e068d4d4',provider_auth='CHAP IxhybRpo env9qj7N6YmI0l',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:22Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:50:23Z,updated_at=2023-04-14T01:50:23Z,use_quota=True,user_id='352c2ca2a1264d50a06b5153a31d9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] detach volume v_add5f919-9b3c-4fbe-883b-daf9f076dc3f from target iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f/luns/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f/luns/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f/luns/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f/luns/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] failed to remove resource iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f because of JDSS resource v_add5f919-9b3c-4fbe-883b-daf9f076dc3f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] delete target: iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] delete target iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] failed to remove resource iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f because of JDSS resource iqn.2010-10.org.openstack:add5f919-9b3c-4fbe-883b-daf9f076dc3f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] deleating volume v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] get snapshots for volume v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] get volume v_add5f919-9b3c-4fbe-883b-daf9f076dc3f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438431', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110942', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16314161562203568992', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6578611fb0edd01e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302517248', 'san:volume_id': '6578611fb0edd01eb7e8770f2810d203f1c908d7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83334', 'name': 'v_add5f919-9b3c-4fbe-883b-daf9f076dc3f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] delete volume:v_add5f919-9b3c-4fbe-883b-daf9f076dc3f recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_add5f919-9b3c-4fbe-883b-daf9f076dc3f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] volume v_add5f919-9b3c-4fbe-883b-daf9f076dc3f deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.quota [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Created reservations ['ad488dd5-9c11-436a-9375-dca8a261e612', '30a86b7b-4d4c-4e4c-9449-a83aa7b8a790', '5769d792-9549-473f-af54-0e2f0061ae61', 'de585cd0-c0bf-4723-b4d7-aa93a97daa60'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Geting {'code': 200, 'error': None, 'data': {'available': '114302590976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.manager [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:50:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Deleted volume successfully. Apr 14 01:50:25 user cinder-volume[73579]: DEBUG cinder.coordination [None req-96e47365-6a43-4eca-911d-0098d1b49e20 tempest-VolumesTransfersV355Test-942460041 None] Lock "cinder-add5f919-9b3c-4fbe-883b-daf9f076dc3f-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:50:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:50:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:50:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:50:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114302590976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:50:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:50:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:DELETE=3,cinder:SELECT=41,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (79578bdd-4c03-4c50-9210-cec43091b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092d0f13-6809-4147-9e9b-5011bd362cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092d0f13-6809-4147-9e9b-5011bd362cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-821960479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=016cf8b7-6ab7-4810-bc0a-a27d51484e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=757f5507-fd92-4216-a93a-ebfa57074825,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:50:55Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ab3c85-2f43-4f3a-9bd0-c11faaf97a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ab3c85-2f43-4f3a-9bd0-c11faaf97a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2725a411-8deb-4391-a7a8-0e82aa4a1218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2725a411-8deb-4391-a7a8-0e82aa4a1218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'volume_name': 'volume-016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'volume_size': 1, 'snapshot_id': '757f5507-fd92-4216-a93a-ebfa57074825'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3682beb-726a-41ab-ad74-8304c523d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3682beb-726a-41ab-ad74-8304c523d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16689a75-b98f-4dca-b777-46c2a8f5eed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:55 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Volume 016cf8b7-6ab7-4810-bc0a-a27d51484e71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'volume_size': 1, 'snapshot_id': '757f5507-fd92-4216-a93a-ebfa57074825'} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] create volume 016cf8b7-6ab7-4810-bc0a-a27d51484e71 from snapshot 757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] cloning s_757f5507-fd92-4216-a93a-ebfa57074825 to v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] create snapshot v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_016cf8b7-6ab7-4810-bc0a-a27d51484e71'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] create volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 from snapshot v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:50:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_757f5507-fd92-4216-a93a-ebfa57074825@v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'is_clone': True, 'full_name': 'Pool-0/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'name': 'v_016cf8b7-6ab7-4810-bc0a-a27d51484e71'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] get volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_757f5507-fd92-4216-a93a-ebfa57074825@v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438466', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '110955', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17983480742682180150', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3fa4f838ee2bd5b6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302562304', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83293', 'name': 'v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16689a75-b98f-4dca-b777-46c2a8f5eed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'volume_size': 1, 'snapshot_id': '757f5507-fd92-4216-a93a-ebfa57074825'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104407b1-d02e-4c5e-96f3-c63bff9eb268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:50:57 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Volume volume-016cf8b7-6ab7-4810-bc0a-a27d51484e71 (016cf8b7-6ab7-4810-bc0a-a27d51484e71): created successfully Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104407b1-d02e-4c5e-96f3-c63bff9eb268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:50:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Flow 'volume_create_manager' (79578bdd-4c03-4c50-9210-cec43091b837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:50:57 user cinder-volume[73579]: INFO cinder.volume.manager [None req-25c87fc4-cf37-4656-a3e9-e2ebd4943119 tempest-SnapshotDataIntegrityTests-919714320 None] Created volume successfully. Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] create export for volume: 016cf8b7-6ab7-4810-bc0a-a27d51484e71. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] ensure volume 016cf8b7-6ab7-4810-bc0a-a27d51484e71 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] check if targe iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] create target and attach volume 016cf8b7-6ab7-4810-bc0a-a27d51484e71 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] create target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:50:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Flow 'volume_create_manager' (42a49a0c-63e7-4c4e-9aba-ff81f6cfa143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69ade02-d552-4188-8210-9db2b26d3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69ade02-d552-4188-8210-9db2b26d3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-846878611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=26c6e12f-4381-4acd-a6e5-a979a6886f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d05ca328d64f2aa1d19550475edba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:51:01Z,use_quota=True,user_id='2a5da3e233c74524a953ce0d4e074077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9519d8-3439-43a6-b54b-b60333cf8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9519d8-3439-43a6-b54b-b60333cf8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6f3b57-6cb7-4290-9778-0efdcf2fd9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6f3b57-6cb7-4290-9778-0efdcf2fd9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c6e12f-4381-4acd-a6e5-a979a6886f25', 'volume_name': 'volume-26c6e12f-4381-4acd-a6e5-a979a6886f25', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3719b0-667b-40be-a724-0621d6e4b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3719b0-667b-40be-a724-0621d6e4b35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec70b77b-0117-4d5b-9758-da70714d82af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:51:00 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Volume 26c6e12f-4381-4acd-a6e5-a979a6886f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c6e12f-4381-4acd-a6e5-a979a6886f25', 'volume_size': 1} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] creating volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] create volume {'name': 'v_26c6e12f-4381-4acd-a6e5-a979a6886f25', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_26c6e12f-4381-4acd-a6e5-a979a6886f25', 'is_clone': False, 'name': 'v_26c6e12f-4381-4acd-a6e5-a979a6886f25'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec70b77b-0117-4d5b-9758-da70714d82af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c6e12f-4381-4acd-a6e5-a979a6886f25', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:51:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918f3bc4-5d7d-4c4a-b90a-61b51317817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:51:01 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Volume volume-26c6e12f-4381-4acd-a6e5-a979a6886f25 (26c6e12f-4381-4acd-a6e5-a979a6886f25): created successfully Apr 14 01:51:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918f3bc4-5d7d-4c4a-b90a-61b51317817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:51:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Flow 'volume_create_manager' (42a49a0c-63e7-4c4e-9aba-ff81f6cfa143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:51:01 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4305a4e2-35a9-4afc-8ddb-133b6605aa97 tempest-AttachVolumeShelveTestJSON-2042065984 None] Created volume successfully. Apr 14 01:51:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] atach volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 to target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:51:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3366613466383338', 'lun': 0, 'mode': 'wt', 'name': 'v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'prod_id': 'Storage', 'scsi_id': '3fa4f838ee2bd5b6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] add credentails to target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:51:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 201, 'error': None, 'data': {'name': 'nWVdFpDI'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] initialize_connection for 016cf8b7-6ab7-4810-bc0a-a27d51484e71 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:51:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWVdFpDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ee08809a-e062-41c2-afd0-27bec41e4406'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:51:04 user cinder-volume[73579]: INFO cinder.volume.manager [req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 req-72dbc00c-3427-444f-990e-547a084f2c18 tempest-SnapshotDataIntegrityTests-919714320 None] attachment_update completed successfully. Apr 14 01:51:08 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=30,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] terminate connection for 016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:51:08 user cinder-volume[73579]: INFO cinder.volume.manager [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Terminate volume connection completed successfully. Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Deleting attachment ee08809a-e062-41c2-afd0-27bec41e4406. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: 016cf8b7-6ab7-4810-bc0a-a27d51484e71. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-821960479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=016cf8b7-6ab7-4810-bc0a-a27d51484e71,launched_at=2023-04-14T01:50:58Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP nWVdFpDI U5ARzD6utIdbla',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:55Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=757f5507-fd92-4216-a93a-ebfa57074825,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:51:07Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 from target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4658a68b-3303-4a43-882a-b888826c4b72 req-50e92ca1-2517-4c7c-9f7f-bfef2b5d9d24 tempest-SnapshotDataIntegrityTests-919714320 None] target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] terminate connection for cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:51:13 user cinder-volume[73579]: INFO cinder.volume.manager [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Terminate volume connection completed successfully. Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Deleting attachment 89becd1c-3c20-46ef-8267-7db080ef09a2. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: cc92e1f9-d41a-47d9-abab-eca949db9d8e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cc92e1f9-d41a-47d9-abab-eca949db9d8e,launched_at=2023-04-14T01:49:26Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP WOKSIlVx XlQbULkiPCghmq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:23Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=8c494dc1-9b6c-456f-9b65-71233f5e3f85,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:49:34Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] detach volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e from target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-13ab5a29-cfdd-4c03-a9f6-0bebcc981c00 tempest-TestVolumeBootPattern-224521177 None] target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.coordination [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-cc92e1f9-d41a-47d9-abab-eca949db9d8e-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.coordination [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-cc92e1f9-d41a-47d9-abab-eca949db9d8e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: cc92e1f9-d41a-47d9-abab-eca949db9d8e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cc92e1f9-d41a-47d9-abab-eca949db9d8e,launched_at=2023-04-14T01:49:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP WOKSIlVx XlQbULkiPCghmq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:23Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=8c494dc1-9b6c-456f-9b65-71233f5e3f85,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:51:14Z,updated_at=2023-04-14T01:51:14Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] detach volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e from target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e/luns/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e because of JDSS resource v_cc92e1f9-d41a-47d9-abab-eca949db9d8e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e because of JDSS resource iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] deleating volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] get volume v_cc92e1f9-d41a-47d9-abab-eca949db9d8e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85@v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438374', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26120192', 'sharesmb': None, 'createtxg': '110853', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8308070362337454105', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '282624', 'logicalused': '1228800', 'compressratio': '5.26', 'rootcontext': 'none', 'default_scsi_id': '5200cf49c5c5f2c4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302324736', 'san:volume_id': '5200cf49c5c5f2c4c95722cd72df456824e0f600', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '282624', 'objsetid': '82863', 'name': 'v_cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '282624', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] delete snapshot v_cc92e1f9-d41a-47d9-abab-eca949db9d8e of volume s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots/v_cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] snapshot v_cc92e1f9-d41a-47d9-abab-eca949db9d8e deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:51:16 user cinder-volume[73579]: DEBUG cinder.quota [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Created reservations ['97fd7c9b-7346-431f-a3f0-d4d34e3c5bee', '2936b5f0-6cb0-4e06-9029-1e70a94aaeec', '18d72564-bfe6-406b-addd-4284202888c4', '4f93ed96-1df5-4cce-bf54-4c8e72cec6fd'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:51:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:51:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:51:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'available': '114302656512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:51:17 user cinder-volume[73579]: DEBUG cinder.manager [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:51:17 user cinder-volume[73579]: INFO cinder.volume.manager [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Deleted volume successfully. Apr 14 01:51:17 user cinder-volume[73579]: DEBUG cinder.coordination [req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb req-15d00ef3-f74b-423c-9e50-c44922c57362 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-cc92e1f9-d41a-47d9-abab-eca949db9d8e-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:51:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=42,cinder:UPDATE=15,cinder:INSERT=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:51:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:51:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:51:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114302656512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:51:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:51:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Acquiring lock "cinder-016cf8b7-6ab7-4810-bc0a-a27d51484e71-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-016cf8b7-6ab7-4810-bc0a-a27d51484e71-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: 016cf8b7-6ab7-4810-bc0a-a27d51484e71. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-821960479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=016cf8b7-6ab7-4810-bc0a-a27d51484e71,launched_at=2023-04-14T01:50:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP nWVdFpDI U5ARzD6utIdbla',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:50:55Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=757f5507-fd92-4216-a93a-ebfa57074825,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:51:58Z,updated_at=2023-04-14T01:51:58Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 from target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71/luns/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 because of JDSS resource v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 because of JDSS resource iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] deleating volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] get snapshots for volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] get volume v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_757f5507-fd92-4216-a93a-ebfa57074825@v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438466', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '110955', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17983480742682180150', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '3fa4f838ee2bd5b6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302656512', 'san:volume_id': '3fa4f838ee2bd5b65159d89f967029d006f119f0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '83293', 'name': 'v_016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] delete snapshot v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 of volume s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:51:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots/v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] snapshot v_016cf8b7-6ab7-4810-bc0a-a27d51484e71 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.quota [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Created reservations ['e3746415-9eb1-4b55-a2eb-4f102ab898a8', 'ba9e9d8e-7ef4-4a5d-91a3-deaeea1b07c1', 'b1bf0cc3-4bee-4ee5-b2fc-79c28ea10a0f', '4efb2c7e-0211-40b4-8967-ca7f599f8b38'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'available': '114302799872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.manager [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:52:00 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Deleted volume successfully. Apr 14 01:52:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d6a0cc05-6e81-4d26-9382-f2f625ca72a3 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-016cf8b7-6ab7-4810-bc0a-a27d51484e71-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Acquiring lock "cinder-4044000e-5f2c-4303-b69d-07287f59fbcb-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-4044000e-5f2c-4303-b69d-07287f59fbcb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: 4044000e-5f2c-4303-b69d-07287f59fbcb. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1127664140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4044000e-5f2c-4303-b69d-07287f59fbcb,launched_at=2023-04-14T01:49:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP BOyRmVdS xbdGEzmKYTX7u2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:53Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=df31f8b5-2c54-4c92-ae47-c7b937f994fb,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:52:01Z,updated_at=2023-04-14T01:52:01Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_4044000e-5f2c-4303-b69d-07287f59fbcb from target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns/v_4044000e-5f2c-4303-b69d-07287f59fbcb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb/luns/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb because of JDSS resource v_4044000e-5f2c-4303-b69d-07287f59fbcb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb because of JDSS resource iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] deleating volume v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] get snapshots for volume v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] get volume v_4044000e-5f2c-4303-b69d-07287f59fbcb info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb@v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438403', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '110903', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7256988606589412216', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '1494292288ef4779', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302799872', 'san:volume_id': '1494292288ef47798ee6f1d71d6cec396f93e170', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '83267', 'name': 'v_4044000e-5f2c-4303-b69d-07287f59fbcb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] delete snapshot v_4044000e-5f2c-4303-b69d-07287f59fbcb of volume s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-8c494dc1-9b6c-456f-9b65-71233f5e3f85-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-8c494dc1-9b6c-456f-9b65-71233f5e3f85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] deleating snapshot s_8c494dc1-9b6c-456f-9b65-71233f5e3f85. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] get volume s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e@s_8c494dc1-9b6c-456f-9b65-71233f5e3f85', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438367', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '110846', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3289118254469452722', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f7e2d3ca6c5aaeb6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302894080', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '82977', 'name': 's_8c494dc1-9b6c-456f-9b65-71233f5e3f85', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] delete snapshot s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 of volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots/v_4044000e-5f2c-4303-b69d-07287f59fbcb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] snapshot v_4044000e-5f2c-4303-b69d-07287f59fbcb deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:03 user cinder-volume[73579]: DEBUG cinder.quota [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Created reservations ['18818d38-ebea-4d5b-8446-798f41ef2e34', '7f3e5ea7-a9dd-406c-ab82-f3e54b61f08d', 'ae20807b-d882-4cce-bb79-b6d61f158386', 'fa6ae380-f511-4c2c-b590-0993d8a8f77f'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:52:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:52:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'available': '114302930944', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.manager [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:52:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Deleted volume successfully. Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb76e8ec-03e2-4d16-ad22-253ee724331b tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-4044000e-5f2c-4303-b69d-07287f59fbcb-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots/s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] snapshot s_8c494dc1-9b6c-456f-9b65-71233f5e3f85 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.quota [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Created reservations ['652b2aaf-5735-48eb-b933-ad333509568e', '912a3eb1-d507-4a3f-a892-a05c7aadc212', '465fdd08-1b6e-42f7-bc14-df7bc246c71c', 'b1e50770-ea89-48a8-8fdd-14b27a701fba'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Delete snapshot completed successfully. Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c7baf2ec-f8c4-4fe6-8d5f-d5325ccc827c tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-8c494dc1-9b6c-456f-9b65-71233f5e3f85-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Acquiring lock "cinder-e59663b0-f628-4a16-8c39-38b28a9a8530-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-e59663b0-f628-4a16-8c39-38b28a9a8530-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: e59663b0-f628-4a16-8c39-38b28a9a8530. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1975546726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e59663b0-f628-4a16-8c39-38b28a9a8530,launched_at=2023-04-14T01:48:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP qFBPsMOy v0zSwfYbgL9pMT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:48:50Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=c240a035-a4c9-4b0f-9e37-04d8aea59cb8,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:52:05Z,updated_at=2023-04-14T01:52:05Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 from target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns/v_e59663b0-f628-4a16-8c39-38b28a9a8530'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530/luns/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 because of JDSS resource v_e59663b0-f628-4a16-8c39-38b28a9a8530 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 because of JDSS resource iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] deleating volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] get snapshots for volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] get volume v_e59663b0-f628-4a16-8c39-38b28a9a8530 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8@v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438340', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '110812', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1497690921485351853', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '29b1b86d8400bd56', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114302988288', 'san:volume_id': '29b1b86d8400bd560ad296863ab4f92a0ab34ac3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '83204', 'name': 'v_e59663b0-f628-4a16-8c39-38b28a9a8530', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] delete snapshot v_e59663b0-f628-4a16-8c39-38b28a9a8530 of volume s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots/v_e59663b0-f628-4a16-8c39-38b28a9a8530 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] snapshot v_e59663b0-f628-4a16-8c39-38b28a9a8530 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:06 user cinder-volume[73579]: DEBUG cinder.quota [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Created reservations ['d3c6d4a0-d31b-4a78-89a4-d297a58a07e9', '8c5c905b-9a3c-48dd-ad51-5d40364b55c6', 'b1f34202-c507-4553-9cdd-06f39261c0e2', '6a45085d-c08d-4703-ba50-266f35e31066'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:52:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:52:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] terminate connection for f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:52:07 user cinder-volume[73579]: INFO cinder.volume.manager [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Terminate volume connection completed successfully. Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Deleting attachment 8027938d-3ad1-4401-b369-fc538dd26498. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: f9cb54ed-9520-43e9-a1c8-2be10b7f955e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1317814532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9cb54ed-9520-43e9-a1c8-2be10b7f955e,launched_at=2023-04-14T01:47:24Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP sxmOykTu ujat9KyDeX7mx6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:22Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:47:34Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] detach volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e from target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303131648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.manager [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:52:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Deleted volume successfully. Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-fbde2e48-b687-4323-b963-958e5918bd2a tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-e59663b0-f628-4a16-8c39-38b28a9a8530-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Acquiring lock "cinder-757f5507-fd92-4216-a93a-ebfa57074825-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-757f5507-fd92-4216-a93a-ebfa57074825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] deleating snapshot s_757f5507-fd92-4216-a93a-ebfa57074825. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] get snapshots for volume s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-26b7fb7d-3b7d-49ff-8a17-c748c80e3f16 tempest-TestVolumeBootPattern-224521177 None] target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.coordination [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-f9cb54ed-9520-43e9-a1c8-2be10b7f955e-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:07 user cinder-volume[73579]: DEBUG cinder.coordination [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-f9cb54ed-9520-43e9-a1c8-2be10b7f955e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=54,cinder:UPDATE=40,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: f9cb54ed-9520-43e9-a1c8-2be10b7f955e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1317814532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9cb54ed-9520-43e9-a1c8-2be10b7f955e,launched_at=2023-04-14T01:47:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP sxmOykTu ujat9KyDeX7mx6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:22Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:52:08Z,updated_at=2023-04-14T01:52:08Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] detach volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e from target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e/luns/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e because of JDSS resource v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e because of JDSS resource iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] deleating volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] get volume s_757f5507-fd92-4216-a93a-ebfa57074825 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62@s_757f5507-fd92-4216-a93a-ebfa57074825', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_757f5507-fd92-4216-a93a-ebfa57074825', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438287', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '110704', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14061819365822825187', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '34789e76a64fa114', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303131648', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '82844', 'name': 's_757f5507-fd92-4216-a93a-ebfa57074825', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] delete snapshot s_757f5507-fd92-4216-a93a-ebfa57074825 of volume v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] get volume v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438252', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '110647', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14229966085916253964', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10125312', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': '3b64ae281c6fdf4c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303131648', 'san:volume_id': '3b64ae281c6fdf4c31636dd5b24ff7eaef30f2e4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10125312', 'objsetid': '82476', 'name': 'v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10125312', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] delete snapshot v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_757f5507-fd92-4216-a93a-ebfa57074825 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] snapshot s_757f5507-fd92-4216-a93a-ebfa57074825 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:09 user cinder-volume[73579]: DEBUG cinder.quota [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Created reservations ['ee8d9531-5b18-4dea-b807-2d7e2ef700ba', 'f6023661-fdbe-457b-8428-e16b691c3e63', '367ff83e-86cd-478b-a1a0-4d91f95a4200', '15cbcebc-7bb4-4ce3-bcf9-9c3abdf36a4b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:09 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=62,cinder:INSERT=12,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Delete snapshot completed successfully. Apr 14 01:52:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-08c2fa71-32e2-45ff-bb5a-d73cd1323a47 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-757f5507-fd92-4216-a93a-ebfa57074825-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] snapshot v_f9cb54ed-9520-43e9-a1c8-2be10b7f955e deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.quota [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Created reservations ['1131229c-e581-46e6-a4a4-3d185a789489', '3f5212f8-74aa-4dcf-80d0-4db88260023b', 'aab48acc-79f5-418c-b7f0-5048a69b1f0b', '5ac15640-bcba-4815-8833-ba9b6b4c78fd'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'available': '114313412608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.manager [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:52:10 user cinder-volume[73579]: INFO cinder.volume.manager [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Deleted volume successfully. Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.coordination [req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 req-8728a9a1-05d0-46c2-bae9-8caede6c5794 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-f9cb54ed-9520-43e9-a1c8-2be10b7f955e-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Acquiring lock "cinder-df31f8b5-2c54-4c92-ae47-c7b937f994fb-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-df31f8b5-2c54-4c92-ae47-c7b937f994fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] deleating snapshot s_df31f8b5-2c54-4c92-ae47-c7b937f994fb. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] get snapshots for volume s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] get volume s_df31f8b5-2c54-4c92-ae47-c7b937f994fb info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62@s_df31f8b5-2c54-4c92-ae47-c7b937f994fb', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438285', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '110692', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7638649471837619278', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8dc63fcf5ee2c5a7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114313412608', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '81553', 'name': 's_df31f8b5-2c54-4c92-ae47-c7b937f994fb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] delete snapshot s_df31f8b5-2c54-4c92-ae47-c7b937f994fb of volume v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_df31f8b5-2c54-4c92-ae47-c7b937f994fb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] snapshot s_df31f8b5-2c54-4c92-ae47-c7b937f994fb deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.quota [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Created reservations ['f4ada20b-3bd0-4267-b657-9002d784e4fe', 'b66ae8d6-c850-4399-b585-0972d40debad', 'a5e0e12c-28c1-43cc-afd3-8bca0d170859', 'bbbd5f8c-61b3-45cc-9315-d041c1cbb7fb'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:13 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Delete snapshot completed successfully. Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c257e0b8-c3c9-4f38-9ffa-13fc4b871061 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-df31f8b5-2c54-4c92-ae47-c7b937f994fb-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] terminate connection for b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:52:13 user cinder-volume[73579]: INFO cinder.volume.manager [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Terminate volume connection completed successfully. Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Deleting attachment 3ce0e3a5-4206-4f9e-b8f7-44479c48a4ef. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1190624143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b1446339-0ce8-401e-b2e0-c4811b486a1a,launched_at=2023-04-14T01:49:12Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP MbmBcKyr FYMbrv68h7ApuU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:10Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:52:13Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] detach volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a from target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Acquiring lock "cinder-c240a035-a4c9-4b0f-9e37-04d8aea59cb8-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-c240a035-a4c9-4b0f-9e37-04d8aea59cb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] deleating snapshot s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] get snapshots for volume s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-67e29ff4-506c-4a94-954b-e159410d6ed8 req-5ae1df12-99fd-4a54-8df4-750f14124a33 tempest-ServerActionsTestJSON-2035821517 None] target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] get volume s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62@s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438281', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '110681', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14880993840801264800', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ce8f95e6f1a65c2e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114313695232', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '82503', 'name': 's_c240a035-a4c9-4b0f-9e37-04d8aea59cb8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] delete snapshot s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 of volume v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:52:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Flow 'volume_create_manager' (ddb20c10-e4fc-4392-a32f-fd03e76b66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c58593-c195-49ac-83db-a22beb8bb11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots/s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] snapshot s_c240a035-a4c9-4b0f-9e37-04d8aea59cb8 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c58593-c195-49ac-83db-a22beb8bb11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:16Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2f2f2823-8b6e-49ae-ad4e-ed05a02421ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c39c8299e46368012a947fdfbe5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:52:17Z,use_quota=True,user_id='7ed01a83531f4c6bb18a4593284baf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf88e32-8f6e-4123-8d78-e70fca3258e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf88e32-8f6e-4123-8d78-e70fca3258e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cdb72e-339e-474f-9101-60c2405d6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.quota [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Created reservations ['0a0f0e52-0f0a-4290-9713-78ef4d1cfbdb', '9abf9e21-78f6-487f-8511-494fa68f62f0', 'c08d57f8-e063-40ea-ac51-9d2f2cdfb0e9', 'cc75b6ba-5bf1-439d-9954-870811ca2354'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Delete snapshot completed successfully. Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6e45f900-0846-4633-9980-73d11fbdf7c5 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-c240a035-a4c9-4b0f-9e37-04d8aea59cb8-delete_snapshot" released by "delete_snapshot" :: held 2.592s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cdb72e-339e-474f-9101-60c2405d6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'volume_name': 'volume-2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3572c179-6500-464c-b96d-7b671fb6d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3572c179-6500-464c-b96d-7b671fb6d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5489e5c-f626-4bff-9026-d3e827c599d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:16 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Volume 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Cloning 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.coordination [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.coordination [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.image.cache [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 52, 16, 800735)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.image.cache [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.coordination [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.image.cache [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 52, 16, 815274)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.image.cache [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create snapshot v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create volume v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae from snapshot v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Acquiring lock "cinder-64fbddc5-4def-42b8-8084-284892fa8b62-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-64fbddc5-4def-42b8-8084-284892fa8b62-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'is_clone': True, 'full_name': 'Pool-0/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'name': 'v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] get volume v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] remove_export for volume: 64fbddc5-4def-42b8-8084-284892fa8b62. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-356055281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64fbddc5-4def-42b8-8084-284892fa8b62,launched_at=2023-04-14T01:47:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740488dbb5114fb2b38be20f8ce4adb0',provider_auth='CHAP csJKGTSq oTeqrsVW7UkOd4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:47:37Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:52:19Z,updated_at=2023-04-14T01:52:19Z,use_quota=True,user_id='34e25e45353e40b9a8bb14736c03fdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] detach volume v_64fbddc5-4def-42b8-8084-284892fa8b62 from target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns/v_64fbddc5-4def-42b8-8084-284892fa8b62'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62/luns/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 because of JDSS resource v_64fbddc5-4def-42b8-8084-284892fa8b62 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] delete target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] delete target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] failed to remove resource iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 because of JDSS resource iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] deleating volume v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] get snapshots for volume v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438547', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111024', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6273520597880973611', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1fc43c9e17dad57c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114313977856', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82334', 'name': 'v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Marking volume 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Creating volume glance metadata for volume 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=58,cinder:INSERT=11,cinder:UPDATE=31 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5489e5c-f626-4bff-9026-d3e827c599d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbb9436-54a7-459d-a4d8-946e728f568e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:19 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Volume volume-2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (2f2f2823-8b6e-49ae-ad4e-ed05a02421ae): created successfully Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbb9436-54a7-459d-a4d8-946e728f568e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Flow 'volume_create_manager' (ddb20c10-e4fc-4392-a32f-fd03e76b66c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:52:19 user cinder-volume[73579]: INFO cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-c99bdee6-f583-4cf3-8ee1-f9da7f56a228 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Created volume successfully. Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] get volume v_64fbddc5-4def-42b8-8084-284892fa8b62 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_64fbddc5-4def-42b8-8084-284892fa8b62', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438267', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '110657', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11373169030391451757', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '475136', 'logicalused': '1892352', 'compressratio': '4.52', 'rootcontext': 'none', 'default_scsi_id': 'abb3a1d6daa61742', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114313953280', 'san:volume_id': 'abb3a1d6daa61742dd74747c3674e0618c5b0105', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '475136', 'objsetid': '82592', 'name': 'v_64fbddc5-4def-42b8-8084-284892fa8b62', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '475136', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] delete volume:v_64fbddc5-4def-42b8-8084-284892fa8b62 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64fbddc5-4def-42b8-8084-284892fa8b62 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] volume v_64fbddc5-4def-42b8-8084-284892fa8b62 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG cinder.quota [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Created reservations ['fb4eaac2-875d-4b60-8300-1353d0db1537', 'd73f9c30-9287-4f3f-8929-e6d81f333905', '6e137e78-08a5-4975-9221-eb5c2d604b4f', '10be4b5d-bfe0-47ee-8f72-e90d1bc4a45e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=53,cinder:INSERT=16,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create export for volume: 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] ensure volume 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] check if targe iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Geting {'code': 200, 'error': None, 'data': {'available': '114314502144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.manager [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create target and attach volume 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] create target iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Deleted volume successfully. Apr 14 01:52:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5cba3a51-d15b-431d-92fb-bb17b42b8f32 tempest-SnapshotDataIntegrityTests-919714320 None] Lock "cinder-64fbddc5-4def-42b8-8084-284892fa8b62-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Flow 'volume_create_manager' (f9b8d279-1ed4-4f49-bce3-f2930b8ce796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25cf159-009f-44d1-ba99-b2410e516e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25cf159-009f-44d1-ba99-b2410e516e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1381772145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4d2a082d-59f8-4081-9ace-fc3ae1219b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:52:25Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f371da7a-3525-4986-9708-f962357befa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f371da7a-3525-4986-9708-f962357befa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a94a692-204e-4bee-86e6-4f187cf4575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a94a692-204e-4bee-86e6-4f187cf4575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'volume_name': 'volume-4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fbdc06-0825-4a9e-b3d0-8bea4f8a1b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fbdc06-0825-4a9e-b3d0-8bea4f8a1b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83977d6a-6e2f-49eb-b627-2fd42ea62d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Volume 4d2a082d-59f8-4081-9ace-fc3ae1219b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'volume_size': 1} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] creating volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] create volume {'name': 'v_4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] atach volume v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae to target iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'is_clone': False, 'name': 'v_4d2a082d-59f8-4081-9ace-fc3ae1219b10'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83977d6a-6e2f-49eb-b627-2fd42ea62d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a651031-d4cd-4739-bb97-d4b7af5b648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:25 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Volume volume-4d2a082d-59f8-4081-9ace-fc3ae1219b10 (4d2a082d-59f8-4081-9ace-fc3ae1219b10): created successfully Apr 14 01:52:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a651031-d4cd-4739-bb97-d4b7af5b648e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Flow 'volume_create_manager' (f9b8d279-1ed4-4f49-bce3-f2930b8ce796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:52:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6161047d-704a-4e9f-829f-1f19bee28052 tempest-AttachVolumeTestJSON-296004410 None] Created volume successfully. Apr 14 01:52:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3166633433633965', 'lun': 0, 'mode': 'wt', 'name': 'v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'prod_id': 'Storage', 'scsi_id': '1fc43c9e17dad57c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] add credentails to target iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:52:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 201, 'error': None, 'data': {'name': 'AUTEzbSm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] initialize_connection for 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:52:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '552eb2d1-8cf4-4fea-88fd-1f7f5222eb5b'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:52:26 user cinder-volume[73579]: INFO cinder.volume.manager [req-2ea067a1-94a3-40e4-bd9c-b1d125585546 req-54818594-db76-4537-a3e2-76c2a3831765 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] attachment_update completed successfully. Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] create export for volume: 4d2a082d-59f8-4081-9ace-fc3ae1219b10. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] ensure volume 4d2a082d-59f8-4081-9ace-fc3ae1219b10 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] check if targe iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] create target and attach volume 4d2a082d-59f8-4081-9ace-fc3ae1219b10 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] create target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] atach volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 to target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114314407936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3135376331363361', 'lun': 0, 'mode': 'wt', 'name': 'v_4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'prod_id': 'Storage', 'scsi_id': '157c163aba9de129'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] add credentails to target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'name': 'txGYAkUr'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] initialize_connection for 4d2a082d-59f8-4081-9ace-fc3ae1219b10 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:52:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3aa66fd4-3a21-4583-b2fb-ccf9bc8e7387'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:52:31 user cinder-volume[73579]: INFO cinder.volume.manager [req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a req-916434d7-fe1d-4779-9942-be5d3c8b67a0 tempest-AttachVolumeTestJSON-296004410 None] attachment_update completed successfully. Apr 14 01:52:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=43,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=32,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] create export for volume: 26c6e12f-4381-4acd-a6e5-a979a6886f25. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] ensure volume 26c6e12f-4381-4acd-a6e5-a979a6886f25 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] check if targe iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] create target and attach volume 26c6e12f-4381-4acd-a6e5-a979a6886f25 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] create target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] atach volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25 to target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:52:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:57 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:52:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (6920a49e-3d33-4a37-8d4f-2c1bfd230a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:52:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b7c31a-fe76-489b-9e83-eb27fb79241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b7c31a-fe76-489b-9e83-eb27fb79241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1744641460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=450914a2-96ae-4c21-a717-2b391be59860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:52:58Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f267cf6-5855-4890-b8b1-305a932a7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f267cf6-5855-4890-b8b1-305a932a7355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc05d58-0d26-497f-ab1a-704191086ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc05d58-0d26-497f-ab1a-704191086ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '450914a2-96ae-4c21-a717-2b391be59860', 'volume_name': 'volume-450914a2-96ae-4c21-a717-2b391be59860', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4cf81e-0d08-464e-a526-16e262d835a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4cf81e-0d08-464e-a526-16e262d835a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ed3c84-077f-459b-8060-090f8a845ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:52:58 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Volume 450914a2-96ae-4c21-a717-2b391be59860: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-450914a2-96ae-4c21-a717-2b391be59860', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Cloning 450914a2-96ae-4c21-a717-2b391be59860 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 52, 58, 134247)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 1, 52, 58, 147308)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] create snapshot v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3166393839363634', 'lun': 0, 'mode': 'wt', 'name': 'v_26c6e12f-4381-4acd-a6e5-a979a6886f25', 'prod_id': 'Storage', 'scsi_id': '1f989664039e7606'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] add credentails to target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:52:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 201, 'error': None, 'data': {'name': 'zameKywh'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] initialize_connection for 26c6e12f-4381-4acd-a6e5-a979a6886f25 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:52:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zameKywh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '305d36e4-5d4d-4f36-b6f3-a03def2532bf'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:52:59 user cinder-volume[73579]: INFO cinder.volume.manager [req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb req-1a0637b5-05cb-471b-a035-04938bfb2768 tempest-AttachVolumeShelveTestJSON-2042065984 None] attachment_update completed successfully. Apr 14 01:52:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_450914a2-96ae-4c21-a717-2b391be59860'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:52:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] create volume v_450914a2-96ae-4c21-a717-2b391be59860 from snapshot v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:52:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:52:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_450914a2-96ae-4c21-a717-2b391be59860', 'is_clone': True, 'full_name': 'Pool-0/v_450914a2-96ae-4c21-a717-2b391be59860', 'name': 'v_450914a2-96ae-4c21-a717-2b391be59860'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] get volume v_450914a2-96ae-4c21-a717-2b391be59860 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_450914a2-96ae-4c21-a717-2b391be59860', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_450914a2-96ae-4c21-a717-2b391be59860', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438588', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111053', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10528692543993017061', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '677087efeb0f91ec', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304249856', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82371', 'name': 'v_450914a2-96ae-4c21-a717-2b391be59860', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Marking volume 450914a2-96ae-4c21-a717-2b391be59860 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Creating volume glance metadata for volume 450914a2-96ae-4c21-a717-2b391be59860 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ed3c84-077f-459b-8060-090f8a845ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450914a2-96ae-4c21-a717-2b391be59860', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa99acea-5701-4079-b3d1-9c0255b9c4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:53:00 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Volume volume-450914a2-96ae-4c21-a717-2b391be59860 (450914a2-96ae-4c21-a717-2b391be59860): created successfully Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa99acea-5701-4079-b3d1-9c0255b9c4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (6920a49e-3d33-4a37-8d4f-2c1bfd230a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:53:00 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a4054279-0000-470a-8195-78727ee815f4 tempest-TestVolumeBootPattern-224521177 None] Created volume successfully. Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] create export for volume: 450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] ensure volume 450914a2-96ae-4c21-a717-2b391be59860 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] check if targe iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] create target and attach volume 450914a2-96ae-4c21-a717-2b391be59860 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] create target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:53:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] atach volume v_450914a2-96ae-4c21-a717-2b391be59860 to target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:53:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:53:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3637373038376566', 'lun': 0, 'mode': 'wt', 'name': 'v_450914a2-96ae-4c21-a717-2b391be59860', 'prod_id': 'Storage', 'scsi_id': '677087efeb0f91ec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] add credentails to target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:53:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:53:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'name': 'XIKaoMjg'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] initialize_connection for 450914a2-96ae-4c21-a717-2b391be59860 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:53:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9c1b7e06-3262-4333-9a68-96d7ee34a919'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:53:08 user cinder-volume[73579]: INFO cinder.volume.manager [req-5f4dc817-6826-42c6-924f-9cbc2b02d67d req-834ae131-4b01-4e13-97aa-4a4a05e5e902 tempest-TestVolumeBootPattern-224521177 None] attachment_update completed successfully. Apr 14 01:53:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=42,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=42,cinder:UPDATE=10,cinder:INSERT=8 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:53:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:53:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:53:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:53:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114294091776', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:53:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Flow 'volume_create_manager' (b1738ddb-b6bf-4210-ab85-769411f30b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983c40eb-d6ab-474d-8f99-a52649dcb056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983c40eb-d6ab-474d-8f99-a52649dcb056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1379220567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4c279a98-9587-47a8-a153-408cc1232415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3de04739384e3ea3a475fee28be3c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:53:35Z,use_quota=True,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd0b7d9-90e4-4e09-84f4-1fbfb40c14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd0b7d9-90e4-4e09-84f4-1fbfb40c14e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9245ed-4030-4bc8-989d-104772bddad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9245ed-4030-4bc8-989d-104772bddad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c279a98-9587-47a8-a153-408cc1232415', 'volume_name': 'volume-4c279a98-9587-47a8-a153-408cc1232415', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413e4c49-9a6e-4146-883e-dcface243382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413e4c49-9a6e-4146-883e-dcface243382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e7f278-8202-40d9-92f2-57fa1b24416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:53:34 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Volume 4c279a98-9587-47a8-a153-408cc1232415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c279a98-9587-47a8-a153-408cc1232415', 'volume_size': 1} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] creating volume v_4c279a98-9587-47a8-a153-408cc1232415. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] create volume {'name': 'v_4c279a98-9587-47a8-a153-408cc1232415', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:53:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:53:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4c279a98-9587-47a8-a153-408cc1232415', 'is_clone': False, 'name': 'v_4c279a98-9587-47a8-a153-408cc1232415'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:53:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e7f278-8202-40d9-92f2-57fa1b24416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c279a98-9587-47a8-a153-408cc1232415', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab32ac5-dbd3-48fe-bb12-a72b26bc9c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:53:35 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Volume volume-4c279a98-9587-47a8-a153-408cc1232415 (4c279a98-9587-47a8-a153-408cc1232415): created successfully Apr 14 01:53:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab32ac5-dbd3-48fe-bb12-a72b26bc9c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:53:35 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Flow 'volume_create_manager' (b1738ddb-b6bf-4210-ab85-769411f30b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:53:35 user cinder-volume[73579]: INFO cinder.volume.manager [None req-38a8b49e-011e-4684-81c8-537587374295 tempest-ServerRescueNegativeTestJSON-1453869246 None] Created volume successfully. Apr 14 01:53:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:03 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Flow 'volume_create_manager' (1b848b56-f86d-4683-9d10-77a6df05646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7593893-d811-46b5-9bf3-7b50011e73f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7593893-d811-46b5-9bf3-7b50011e73f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2138434913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=55aa3df5-b363-4e8f-ac2e-f46bea9ca67f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:54:04Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50560e32-8ed5-41c3-ab85-48c3f94d4886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50560e32-8ed5-41c3-ab85-48c3f94d4886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b2c679-f75e-4ac5-8841-8b1d1255a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b2c679-f75e-4ac5-8841-8b1d1255a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'volume_name': 'volume-55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d95b5e3-f627-4aa1-b273-832f8aca9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d95b5e3-f627-4aa1-b273-832f8aca9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf185381-16d2-4802-9b16-e09de49dd712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:54:04 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'volume_size': 1} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] creating volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] create volume {'name': 'v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'is_clone': False, 'name': 'v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf185381-16d2-4802-9b16-e09de49dd712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:54:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9f1821-0b47-4d33-9789-3b9a6164b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:54:05 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Volume volume-55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (55aa3df5-b363-4e8f-ac2e-f46bea9ca67f): created successfully Apr 14 01:54:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9f1821-0b47-4d33-9789-3b9a6164b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:54:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Flow 'volume_create_manager' (1b848b56-f86d-4683-9d10-77a6df05646c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:54:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-211d04a5-067c-4277-9258-b7e15820989e tempest-ServerActionsTestJSON-2035821517 None] Created volume successfully. Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] create export for volume: 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] ensure volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] check if targe iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] create target and attach volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] create target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] atach volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f to target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:54:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3133633338326462', 'lun': 0, 'mode': 'wt', 'name': 'v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'prod_id': 'Storage', 'scsi_id': '13c382db6b532b8c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] add credentails to target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:54:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'name': 'vNWpMtFL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] initialize_connection for 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:54:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '613e5d74-a21e-42d7-8ed3-3e64d8e621d2'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:54:11 user cinder-volume[73579]: INFO cinder.volume.manager [req-a1cebd51-b651-415e-9d3e-612557424009 req-c37a8e6a-0be1-4b9b-acdf-f3f62a005c6c tempest-ServerActionsTestJSON-2035821517 None] attachment_update completed successfully. Apr 14 01:54:18 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] terminate connection for 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:54:18 user cinder-volume[73579]: INFO cinder.volume.manager [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Terminate volume connection completed successfully. Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Deleting attachment 613e5d74-a21e-42d7-8ed3-3e64d8e621d2. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2138434913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=55aa3df5-b363-4e8f-ac2e-f46bea9ca67f,launched_at=2023-04-14T01:54:05Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP vNWpMtFL cgFWzJqfrGivHB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:54:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:54:14Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] detach volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f from target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:54:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:54:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-2eb74fd9-d8df-412b-b626-0a42222de6a3 tempest-ServerActionsTestJSON-2035821517 None] target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] create export for volume: 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] ensure volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] check if targe iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] create target and attach volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] create target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] atach volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f to target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:54:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3133633338326462', 'lun': 0, 'mode': 'wt', 'name': 'v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'prod_id': 'Storage', 'scsi_id': '13c382db6b532b8c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] add credentails to target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:54:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'name': 'vNWpMtFL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] initialize_connection for 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:54:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4469cfd0-7af5-4ba9-855e-7d4028f7bdbc'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:54:24 user cinder-volume[73579]: INFO cinder.volume.manager [req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 req-413d256d-f26a-4718-9258-6c0c67ab44ad tempest-ServerActionsTestJSON-2035821517 None] attachment_update completed successfully. Apr 14 01:54:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:54:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:54:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:54:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293891072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:54:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:54:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=30,cinder:UPDATE=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] terminate connection for 26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:54:45 user cinder-volume[73579]: INFO cinder.volume.manager [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Terminate volume connection completed successfully. Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Deleting attachment 305d36e4-5d4d-4f36-b6f3-a03def2532bf. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] remove_export for volume: 26c6e12f-4381-4acd-a6e5-a979a6886f25. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-846878611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=26c6e12f-4381-4acd-a6e5-a979a6886f25,launched_at=2023-04-14T01:51:02Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='a6d05ca328d64f2aa1d19550475edba3',provider_auth='CHAP zameKywh N0T3sLwyQ4IuWO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:51:01Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:54:45Z,use_quota=True,user_id='2a5da3e233c74524a953ce0d4e074077',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] detach volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25 from target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:54:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:54:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 req-a017887e-d46d-45c4-8f2f-419b45c63d92 tempest-AttachVolumeShelveTestJSON-2042065984 None] target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:54:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] terminate connection for 450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:54:57 user cinder-volume[73579]: INFO cinder.volume.manager [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Terminate volume connection completed successfully. Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Deleting attachment 9c1b7e06-3262-4333-9a68-96d7ee34a919. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: 450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1744641460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=450914a2-96ae-4c21-a717-2b391be59860,launched_at=2023-04-14T01:53:00Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP XIKaoMjg h6X3AwKMi1ED5y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:58Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:53:09Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] detach volume v_450914a2-96ae-4c21-a717-2b391be59860 from target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:54:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 req-e6c7ee13-c779-4f68-81ba-00030fa12631 tempest-TestVolumeBootPattern-224521177 None] target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:55:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] create export for volume: 4c279a98-9587-47a8-a153-408cc1232415. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] ensure volume 4c279a98-9587-47a8-a153-408cc1232415 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] check if targe iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] create target and attach volume 4c279a98-9587-47a8-a153-408cc1232415 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] create target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293862400', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:55:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:55:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] atach volume v_4c279a98-9587-47a8-a153-408cc1232415 to target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:55:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6363323966666434', 'lun': 0, 'mode': 'wt', 'name': 'v_4c279a98-9587-47a8-a153-408cc1232415', 'prod_id': 'Storage', 'scsi_id': 'cc29ffd487fe9801'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] add credentails to target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:55:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 201, 'error': None, 'data': {'name': 'oHhbCuAY'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] initialize_connection for 4c279a98-9587-47a8-a153-408cc1232415 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:55:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHhbCuAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a980225e-8bc6-4bb0-a839-83ced4f291cc'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:55:35 user cinder-volume[73579]: INFO cinder.volume.manager [req-0169ef51-a395-493c-91c4-774549f08840 req-5e937d89-8a22-4272-b493-77e4fc515ffc tempest-ServerRescueNegativeTestJSON-1453869246 None] attachment_update completed successfully. Apr 14 01:55:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] create export for volume: 450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] ensure volume 450914a2-96ae-4c21-a717-2b391be59860 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] check if targe iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] create target and attach volume 450914a2-96ae-4c21-a717-2b391be59860 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] create target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] atach volume v_450914a2-96ae-4c21-a717-2b391be59860 to target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:55:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3637373038376566', 'lun': 0, 'mode': 'wt', 'name': 'v_450914a2-96ae-4c21-a717-2b391be59860', 'prod_id': 'Storage', 'scsi_id': '677087efeb0f91ec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] add credentails to target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:55:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:55:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:55:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'name': 'XIKaoMjg'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:55:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] initialize_connection for 450914a2-96ae-4c21-a717-2b391be59860 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:55:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3a19bcd6-96f7-4c66-b2e0-5b4533886c2f'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:55:54 user cinder-volume[73579]: INFO cinder.volume.manager [req-20695d05-9199-495f-936d-05833742b4c7 req-f77564fa-4fb9-4cfd-8318-2a8636b0197c tempest-TestVolumeBootPattern-224521177 None] attachment_update completed successfully. Apr 14 01:56:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] terminate connection for 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:56:07 user cinder-volume[73579]: INFO cinder.volume.manager [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Terminate volume connection completed successfully. Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Deleting attachment 4469cfd0-7af5-4ba9-855e-7d4028f7bdbc. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2138434913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=55aa3df5-b363-4e8f-ac2e-f46bea9ca67f,launched_at=2023-04-14T01:54:05Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP vNWpMtFL cgFWzJqfrGivHB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:54:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:54:30Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] detach volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f from target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:56:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:56:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-e4ef2abd-4701-499d-acbf-d77b446614f8 tempest-ServerActionsTestJSON-2035821517 None] target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:56:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] create export for volume: 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:56:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] ensure volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:56:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] check if targe iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:56:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] create target and attach volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:56:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] create target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:56:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] atach volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f to target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:56:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3133633338326462', 'lun': 0, 'mode': 'wt', 'name': 'v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'prod_id': 'Storage', 'scsi_id': '13c382db6b532b8c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] add credentails to target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:56:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'name': 'vNWpMtFL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] initialize_connection for 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:56:14 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4e685821-d1fd-466b-9876-ae4ade85b28d'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:56:14 user cinder-volume[73579]: INFO cinder.volume.manager [req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a req-11bd2f3e-40ab-4f90-aa37-e9f080bd3290 tempest-ServerActionsTestJSON-2035821517 None] attachment_update completed successfully. Apr 14 01:56:17 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=30,cinder:UPDATE=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] terminate connection for 4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:56:17 user cinder-volume[73579]: INFO cinder.volume.manager [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Terminate volume connection completed successfully. Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Deleting attachment 3aa66fd4-3a21-4583-b2fb-ccf9bc8e7387. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] remove_export for volume: 4d2a082d-59f8-4081-9ace-fc3ae1219b10. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1381772145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4d2a082d-59f8-4081-9ace-fc3ae1219b10,launched_at=2023-04-14T01:52:26Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth='CHAP txGYAkUr edHrm6CkSPIuZc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:25Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:56:16Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] detach volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 from target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] delete target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:56:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] delete target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:56:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc req-849013dc-b9c5-4236-8bb8-d3b99ee2d60c tempest-AttachVolumeTestJSON-296004410 None] target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:56:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:56:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:56:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:56:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:56:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:56:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293850112', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:56:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:56:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:56:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:57:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:57:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:57:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293846016', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:57:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:57:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] create snapshot e1823775-fa93-49e6-8878-3aee5d31dfc1 for volume 450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:57:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] cloning v_450914a2-96ae-4c21-a717-2b391be59860 to s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:57:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] create snapshot s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:57:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e1823775-fa93-49e6-8878-3aee5d31dfc1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] create volume s_e1823775-fa93-49e6-8878-3aee5d31dfc1 from snapshot s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_450914a2-96ae-4c21-a717-2b391be59860@s_e1823775-fa93-49e6-8878-3aee5d31dfc1', 'is_clone': True, 'full_name': 'Pool-0/s_e1823775-fa93-49e6-8878-3aee5d31dfc1', 'name': 's_e1823775-fa93-49e6-8878-3aee5d31dfc1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] volume s_e1823775-fa93-49e6-8878-3aee5d31dfc1 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:57:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-22990ef6-2da0-4765-8d32-e4493bf527c8 tempest-TestVolumeBootPattern-224521177 None] Create snapshot completed successfully Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (45bde3c1-0e48-49c8-9d47-a7407dbdab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b4c5b5-5476-48ba-8bb1-3f337a2d3c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b4c5b5-5476-48ba-8bb1-3f337a2d3c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1157403262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fd2a58c4-4fc8-4aca-8654-ae325aec4e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e1823775-fa93-49e6-8878-3aee5d31dfc1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:57:41Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca421bf6-a78a-4b8c-9329-455749f3dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca421bf6-a78a-4b8c-9329-455749f3dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e98dac3-07d1-440f-a058-6b6688c40dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e98dac3-07d1-440f-a058-6b6688c40dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'volume_name': 'volume-fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'volume_size': 1, 'snapshot_id': 'e1823775-fa93-49e6-8878-3aee5d31dfc1'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6422d5d9-bccf-483a-b314-d56de6f07350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6422d5d9-bccf-483a-b314-d56de6f07350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd1ae32-0d7e-4200-bcb5-1b6a79d0826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:57:41 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Volume fd2a58c4-4fc8-4aca-8654-ae325aec4e25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'volume_size': 1, 'snapshot_id': 'e1823775-fa93-49e6-8878-3aee5d31dfc1'} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] create volume fd2a58c4-4fc8-4aca-8654-ae325aec4e25 from snapshot e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] cloning s_e1823775-fa93-49e6-8878-3aee5d31dfc1 to v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] create snapshot v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] create volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 from snapshot v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:57:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_e1823775-fa93-49e6-8878-3aee5d31dfc1@v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'is_clone': True, 'full_name': 'Pool-0/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'name': 'v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] get volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_e1823775-fa93-49e6-8878-3aee5d31dfc1@v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438872', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '111152', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12672535438790181656', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e5c4e73a56a20ab8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293764096', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82387', 'name': 'v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Marking volume fd2a58c4-4fc8-4aca-8654-ae325aec4e25 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Copying metadata from snapshot e1823775-fa93-49e6-8878-3aee5d31dfc1 to fd2a58c4-4fc8-4aca-8654-ae325aec4e25. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd1ae32-0d7e-4200-bcb5-1b6a79d0826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'volume_size': 1, 'snapshot_id': 'e1823775-fa93-49e6-8878-3aee5d31dfc1'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c1d562-7899-4b5e-b4e4-c48e077856e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:57:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Volume volume-fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (fd2a58c4-4fc8-4aca-8654-ae325aec4e25): created successfully Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c1d562-7899-4b5e-b4e4-c48e077856e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:57:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Flow 'volume_create_manager' (45bde3c1-0e48-49c8-9d47-a7407dbdab68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:57:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-217f21d2-6bc2-4245-be2d-094b04fd6fb3 tempest-TestVolumeBootPattern-224521177 None] Created volume successfully. Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] create export for volume: fd2a58c4-4fc8-4aca-8654-ae325aec4e25. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] ensure volume fd2a58c4-4fc8-4aca-8654-ae325aec4e25 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] check if targe iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] create target and attach volume fd2a58c4-4fc8-4aca-8654-ae325aec4e25 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] create target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] terminate connection for 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:57:49 user cinder-volume[73579]: INFO cinder.volume.manager [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Terminate volume connection completed successfully. Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Deleting attachment 552eb2d1-8cf4-4fea-88fd-1f7f5222eb5b. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] remove_export for volume: 2f2f2823-8b6e-49ae-ad4e-ed05a02421ae. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:16Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2f2f2823-8b6e-49ae-ad4e-ed05a02421ae,launched_at=2023-04-14T01:52:19Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='219c39c8299e46368012a947fdfbe5fd',provider_auth='CHAP AUTEzbSm 6RluPjmcYDF0EQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:17Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:52:27Z,use_quota=True,user_id='7ed01a83531f4c6bb18a4593284baf05',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] detach volume v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae from target iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/luns/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/luns/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] atach volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 to target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae/luns/v_2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] delete target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:57:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] delete target iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:57:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-31b35708-3b76-4711-ac6e-43c76423d892 req-139e2101-f667-4913-b78a-f1deee5e9f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] target iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:57:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6535633465373361', 'lun': 0, 'mode': 'wt', 'name': 'v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'prod_id': 'Storage', 'scsi_id': 'e5c4e73a56a20ab8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] add credentails to target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:57:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:57:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:57:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 201, 'error': None, 'data': {'name': 'QkZUoSzc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:57:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] initialize_connection for fd2a58c4-4fc8-4aca-8654-ae325aec4e25 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:57:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkZUoSzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '28ad901e-b24f-4192-9b1e-3c64401882cd'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:57:51 user cinder-volume[73579]: INFO cinder.volume.manager [req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 req-d49d4490-95f7-4a3f-bde3-fdf382d56182 tempest-TestVolumeBootPattern-224521177 None] attachment_update completed successfully. Apr 14 01:57:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=36,cinder:UPDATE=7,cinder:INSERT=14 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=35,cinder:UPDATE=8,cinder:INSERT=10,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Flow 'volume_create_manager' (980771ab-ce1f-4d99-a855-48aaa79000ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f097b711-9f15-4fe9-861a-f57c7bb4e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f097b711-9f15-4fe9-861a-f57c7bb4e231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-762453306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=58e2cd82-9771-4c59-8fe0-b03034cbe005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d05ca328d64f2aa1d19550475edba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:58:20Z,use_quota=True,user_id='2a5da3e233c74524a953ce0d4e074077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a34b2d-a4fe-4faa-a8e9-fbc26bf5b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a34b2d-a4fe-4faa-a8e9-fbc26bf5b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42f2d6e-9b07-43e2-b1ea-b88a9051b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42f2d6e-9b07-43e2-b1ea-b88a9051b26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e2cd82-9771-4c59-8fe0-b03034cbe005', 'volume_name': 'volume-58e2cd82-9771-4c59-8fe0-b03034cbe005', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4509d6cd-b255-4e92-93ca-6a6f11fd5bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4509d6cd-b255-4e92-93ca-6a6f11fd5bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2021ee48-61e9-40d9-b4ca-0e27387a5d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:58:20 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Volume 58e2cd82-9771-4c59-8fe0-b03034cbe005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e2cd82-9771-4c59-8fe0-b03034cbe005', 'volume_size': 1} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] creating volume v_58e2cd82-9771-4c59-8fe0-b03034cbe005. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] create volume {'name': 'v_58e2cd82-9771-4c59-8fe0-b03034cbe005', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:58:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:58:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_58e2cd82-9771-4c59-8fe0-b03034cbe005', 'is_clone': False, 'name': 'v_58e2cd82-9771-4c59-8fe0-b03034cbe005'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:58:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2021ee48-61e9-40d9-b4ca-0e27387a5d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e2cd82-9771-4c59-8fe0-b03034cbe005', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:58:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03244c9e-de56-486e-a303-43f0e3b49846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:58:21 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Volume volume-58e2cd82-9771-4c59-8fe0-b03034cbe005 (58e2cd82-9771-4c59-8fe0-b03034cbe005): created successfully Apr 14 01:58:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03244c9e-de56-486e-a303-43f0e3b49846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:58:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Flow 'volume_create_manager' (980771ab-ce1f-4d99-a855-48aaa79000ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:58:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f6a4fee6-e2ea-467c-8591-fe64e33f2da0 tempest-AttachVolumeShelveTestJSON-2042065984 None] Created volume successfully. Apr 14 01:58:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:58:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:58:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:58:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:58:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:58:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293190656', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:58:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:58:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:58:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] terminate connection for 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:58:59 user cinder-volume[73579]: INFO cinder.volume.manager [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Terminate volume connection completed successfully. Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Deleting attachment 4e685821-d1fd-466b-9876-ae4ade85b28d. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2138434913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=55aa3df5-b363-4e8f-ac2e-f46bea9ca67f,launched_at=2023-04-14T01:54:05Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP vNWpMtFL cgFWzJqfrGivHB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:54:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:56:20Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] detach volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f from target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:58:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5806617b-f782-42e6-847d-af93d9466ba3 req-7816bc2e-4cbf-4af1-9954-b8ed1da8ea01 tempest-ServerActionsTestJSON-2035821517 None] target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:59:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] terminate connection for 4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:59:22 user cinder-volume[73579]: INFO cinder.volume.manager [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Terminate volume connection completed successfully. Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Deleting attachment a980225e-8bc6-4bb0-a839-83ced4f291cc. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] remove_export for volume: 4c279a98-9587-47a8-a153-408cc1232415. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1379220567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4c279a98-9587-47a8-a153-408cc1232415,launched_at=2023-04-14T01:53:36Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='6d3de04739384e3ea3a475fee28be3c0',provider_auth='CHAP oHhbCuAY W6OeAc0GaIJMFP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:53:35Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:59:22Z,use_quota=True,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] detach volume v_4c279a98-9587-47a8-a153-408cc1232415 from target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:59:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:59:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:59:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] delete target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:59:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] delete target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:59:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:59:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:59:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:59:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-870b777b-c51c-4bcc-b4b2-196e0f58d118 req-06b21cda-4d4b-4ee9-9af5-078caa8f73bb tempest-ServerRescueNegativeTestJSON-1453869246 None] target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:59:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:59:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:59:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:59:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:59:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] terminate connection for 0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:59:31 user cinder-volume[73579]: INFO cinder.volume.manager [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Terminate volume connection completed successfully. Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Deleting attachment ae1038cb-9890-4797-aade-3705c75e2976. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] remove_export for volume: 0856ebd5-320b-4f5a-b305-4b1a0be6fb22. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:43:45Z,deleted=False,deleted_at=None,display_description='',display_name='73fd9bc1-af0f-41e9-adea-d73323b4a76c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0856ebd5-320b-4f5a-b305-4b1a0be6fb22,launched_at=2023-04-14T01:43:46Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='219c39c8299e46368012a947fdfbe5fd',provider_auth='CHAP hCwSrpEd fvWutcGkX14H6w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:43:45Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:43:55Z,use_quota=True,user_id='7ed01a83531f4c6bb18a4593284baf05',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] detach volume v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22 from target iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/luns/v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/luns/v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22/luns/v_0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] delete target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] delete target iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293178368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:59:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b2dca265-193f-4c8d-aad0-49bee5ebec0a req-4e71d9e8-93cf-460c-9c23-0f6fc4f71697 tempest-ServerBootFromVolumeStableRescueTest-85797606 None] target iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] terminate connection for fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:59:40 user cinder-volume[73579]: INFO cinder.volume.manager [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Terminate volume connection completed successfully. Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Deleting attachment 28ad901e-b24f-4192-9b1e-3c64401882cd. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: fd2a58c4-4fc8-4aca-8654-ae325aec4e25. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1157403262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fd2a58c4-4fc8-4aca-8654-ae325aec4e25,launched_at=2023-04-14T01:57:44Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP QkZUoSzc rUc0TKGXMhID3l',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:57:41Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=e1823775-fa93-49e6-8878-3aee5d31dfc1,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:57:51Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] detach volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 from target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:59:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:59:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:59:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-146f2c29-1a6d-499d-ba24-d160713b5d55 req-c472cda8-25ce-4568-9eb1-915369fc6bda tempest-TestVolumeBootPattern-224521177 None] target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:59:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:14 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-544ca86f-1227-421b-84a0-b9eeebe2a99c req-7c11f2e2-a977-449a-8923-acbb71bd65e6 tempest-AttachVolumeShelveTestJSON-2042065984 None] No connector for attachment 6fe82a83-6208-4d41-a606-fe599a6ebeb7; skipping storage backend terminate_connection call. {{(pid=73579) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4961}} Apr 14 02:00:14 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-544ca86f-1227-421b-84a0-b9eeebe2a99c req-7c11f2e2-a977-449a-8923-acbb71bd65e6 tempest-AttachVolumeShelveTestJSON-2042065984 None] Deleting attachment 6fe82a83-6208-4d41-a606-fe599a6ebeb7. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:00:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-fd2a58c4-4fc8-4aca-8654-ae325aec4e25-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-fd2a58c4-4fc8-4aca-8654-ae325aec4e25-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: fd2a58c4-4fc8-4aca-8654-ae325aec4e25. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1157403262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fd2a58c4-4fc8-4aca-8654-ae325aec4e25,launched_at=2023-04-14T01:57:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP QkZUoSzc rUc0TKGXMhID3l',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:57:41Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=e1823775-fa93-49e6-8878-3aee5d31dfc1,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:00:29Z,updated_at=2023-04-14T02:00:29Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] detach volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 from target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25/luns/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 because of JDSS resource v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 because of JDSS resource iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] deleating volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] get volume v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_e1823775-fa93-49e6-8878-3aee5d31dfc1@v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438872', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '111152', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12672535438790181656', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '266240', 'logicalused': '1097728', 'compressratio': '5.05', 'rootcontext': 'none', 'default_scsi_id': 'e5c4e73a56a20ab8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293178368', 'san:volume_id': 'e5c4e73a56a20ab823f2be5b3a266332126cddf4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.68', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '266240', 'objsetid': '82387', 'name': 'v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '266240', 'logicalreferenced': '43855872', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] delete snapshot v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 of volume s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293178368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots/v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] snapshot v_fd2a58c4-4fc8-4aca-8654-ae325aec4e25 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.quota [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Created reservations ['0c75e9cc-e5b5-4710-85f8-7cbac2bc7a89', '670b9ea1-30ff-4ec9-b368-240cfa4f57ee', 'a6c4570b-a6da-4383-a0a6-7df77059fb66', 'b69782bb-bd77-48dc-b08a-088de5df090c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293493760', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.manager [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:00:32 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Deleted volume successfully. Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f3264917-13e5-4d19-8275-f98e5e2494c6 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-fd2a58c4-4fc8-4aca-8654-ae325aec4e25-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-e1823775-fa93-49e6-8878-3aee5d31dfc1-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-e1823775-fa93-49e6-8878-3aee5d31dfc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] deleating snapshot s_e1823775-fa93-49e6-8878-3aee5d31dfc1. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] get volume s_e1823775-fa93-49e6-8878-3aee5d31dfc1 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_450914a2-96ae-4c21-a717-2b391be59860@s_e1823775-fa93-49e6-8878-3aee5d31dfc1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e1823775-fa93-49e6-8878-3aee5d31dfc1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438869', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '111146', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6246201726815216184', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3456227cd298741d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293493760', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '83325', 'name': 's_e1823775-fa93-49e6-8878-3aee5d31dfc1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] delete snapshot s_e1823775-fa93-49e6-8878-3aee5d31dfc1 of volume v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots/s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots/s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots/s_e1823775-fa93-49e6-8878-3aee5d31dfc1 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] snapshot s_e1823775-fa93-49e6-8878-3aee5d31dfc1 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:00:35 user cinder-volume[73579]: DEBUG cinder.quota [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Created reservations ['40efcc59-cfc4-4268-96f3-080bf0bd0c77', '65c033e6-a45f-4c03-a5ce-c2577970121a', '30b490ed-4b73-4827-b9fc-7bae4aac31f8', 'e461b2dd-9df3-406c-a35a-b7f8e29639b3'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:00:35 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Delete snapshot completed successfully. Apr 14 02:00:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ea095cf9-69cd-4ffc-8e55-9758442d96c8 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-e1823775-fa93-49e6-8878-3aee5d31dfc1-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] terminate connection for 450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:00:38 user cinder-volume[73579]: INFO cinder.volume.manager [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Terminate volume connection completed successfully. Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Deleting attachment 3a19bcd6-96f7-4c66-b2e0-5b4533886c2f. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: 450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1744641460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=450914a2-96ae-4c21-a717-2b391be59860,launched_at=2023-04-14T01:53:00Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP XIKaoMjg h6X3AwKMi1ED5y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:58Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T01:55:54Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] detach volume v_450914a2-96ae-4c21-a717-2b391be59860 from target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:00:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:00:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:00:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 req-dec251bf-a110-482a-ba5d-718559a744e9 tempest-TestVolumeBootPattern-224521177 None] target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:00:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=29,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=28,cinder:UPDATE=18,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Acquiring lock "cinder-4c279a98-9587-47a8-a153-408cc1232415-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Lock "cinder-4c279a98-9587-47a8-a153-408cc1232415-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] remove_export for volume: 4c279a98-9587-47a8-a153-408cc1232415. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1379220567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4c279a98-9587-47a8-a153-408cc1232415,launched_at=2023-04-14T01:53:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3de04739384e3ea3a475fee28be3c0',provider_auth='CHAP oHhbCuAY W6OeAc0GaIJMFP',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:53:35Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:01:03Z,updated_at=2023-04-14T02:01:03Z,use_quota=True,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] detach volume v_4c279a98-9587-47a8-a153-408cc1232415 from target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns/v_4c279a98-9587-47a8-a153-408cc1232415'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415/luns/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] failed to remove resource iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 because of JDSS resource v_4c279a98-9587-47a8-a153-408cc1232415 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] delete target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] delete target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] failed to remove resource iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 because of JDSS resource iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] deleating volume v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] get snapshots for volume v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] get volume v_4c279a98-9587-47a8-a153-408cc1232415 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4c279a98-9587-47a8-a153-408cc1232415', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438624', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111068', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3494946416156861563', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cc29ffd487fe9801', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293678080', 'san:volume_id': 'cc29ffd487fe9801b1c43062a220c539035fed05', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83357', 'name': 'v_4c279a98-9587-47a8-a153-408cc1232415', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] delete volume:v_4c279a98-9587-47a8-a153-408cc1232415 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c279a98-9587-47a8-a153-408cc1232415 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] volume v_4c279a98-9587-47a8-a153-408cc1232415 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:01:05 user cinder-volume[73579]: DEBUG cinder.quota [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Created reservations ['71d7fe2b-e34b-40fa-9f8e-941a2f4e3646', '1c292a56-5359-4b7c-8947-c508edc1a7cb', '3100d23f-799f-4470-b57a-7f62d0812ae8', '70a7b61c-5d4a-4562-b069-0b1ad6f713b3'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:01:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:01:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293747712', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.manager [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:01:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Deleted volume successfully. Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-32dc90f7-6fe3-4894-92f5-1df1d728454c tempest-ServerRescueNegativeTestJSON-1453869246 None] Lock "cinder-4c279a98-9587-47a8-a153-408cc1232415-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Acquiring lock "cinder-8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Lock "cinder-8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] remove_export for volume: 8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1083519269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b,launched_at=2023-04-14T01:49:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3de04739384e3ea3a475fee28be3c0',provider_auth='CHAP mCKhBJuW 8JakuTqHDVj437',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:50Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:01:07Z,updated_at=2023-04-14T02:01:07Z,use_quota=True,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] detach volume v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b from target iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b/luns/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b/luns/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b/luns/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b/luns/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] failed to remove resource iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b because of JDSS resource v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] delete target: iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] delete target iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] failed to remove resource iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b because of JDSS resource iqn.2010-10.org.openstack:8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] deleating volume v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] get snapshots for volume v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] get volume v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438399', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110892', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '568911758706225847', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '89d0f9f8a0842fa3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293747712', 'san:volume_id': '89d0f9f8a0842fa32eb0cc5e6eac13c50d41ed8e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83245', 'name': 'v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] delete volume:v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] volume v_8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:01:08 user cinder-volume[73579]: DEBUG cinder.quota [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Created reservations ['972f8309-0262-46f2-b75b-f77ad5195671', '05f33586-7270-49df-a441-fdc85e670142', '1779f37b-f01f-4230-a58f-5589bac6a1ca', '1e494f28-56ef-4bd8-abd5-d4562b92152e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:01:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:01:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293841920', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:01:09 user cinder-volume[73579]: DEBUG cinder.manager [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:01:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Deleted volume successfully. Apr 14 02:01:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-48cfd4ba-7cee-4ca5-887d-dcd43ff19657 tempest-ServerRescueNegativeTestJSON-1453869246 None] Lock "cinder-8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Flow 'volume_create_manager' (6d754caa-1b7b-455b-862b-98584c70ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc0ed42-22a7-45c5-bfbf-a87f2fdd04aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc0ed42-22a7-45c5-bfbf-a87f2fdd04aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1809232508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=37bdde7f-9588-44b8-b00c-72e92659bab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df1ae30489146b0840782929277b460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:01:21Z,use_quota=True,user_id='d1058d76de7f4e6abf2951d59a190211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9475109-a1b9-44be-88fc-f0034cd8b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9475109-a1b9-44be-88fc-f0034cd8b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925c4721-3077-4217-aff7-881b491346dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925c4721-3077-4217-aff7-881b491346dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37bdde7f-9588-44b8-b00c-72e92659bab5', 'volume_name': 'volume-37bdde7f-9588-44b8-b00c-72e92659bab5', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f5166-61f6-4dd8-ac85-a72e34a764e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f5166-61f6-4dd8-ac85-a72e34a764e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc05090-ed51-4b42-8b61-3872f11d2432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:20 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Volume 37bdde7f-9588-44b8-b00c-72e92659bab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37bdde7f-9588-44b8-b00c-72e92659bab5', 'volume_size': 1} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] creating volume v_37bdde7f-9588-44b8-b00c-72e92659bab5. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] create volume {'name': 'v_37bdde7f-9588-44b8-b00c-72e92659bab5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_37bdde7f-9588-44b8-b00c-72e92659bab5', 'is_clone': False, 'name': 'v_37bdde7f-9588-44b8-b00c-72e92659bab5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc05090-ed51-4b42-8b61-3872f11d2432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bdde7f-9588-44b8-b00c-72e92659bab5', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8e935-d808-4c9d-a799-a98893129907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:21 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Volume volume-37bdde7f-9588-44b8-b00c-72e92659bab5 (37bdde7f-9588-44b8-b00c-72e92659bab5): created successfully Apr 14 02:01:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8e935-d808-4c9d-a799-a98893129907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Flow 'volume_create_manager' (6d754caa-1b7b-455b-862b-98584c70ef92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-917d67e6-9da9-42ed-a543-8b89e6c0b779 tempest-VolumesTransfersV357Test-1479399365 None] Created volume successfully. Apr 14 02:01:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8881641d-64f8-40dc-a849-60b63a768816 tempest-VolumesTransfersV357Test-441093111 None] Transfer volume completed successfully. Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Acquiring lock "cinder-37bdde7f-9588-44b8-b00c-72e92659bab5-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Lock "cinder-37bdde7f-9588-44b8-b00c-72e92659bab5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] remove_export for volume: 37bdde7f-9588-44b8-b00c-72e92659bab5. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1809232508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=37bdde7f-9588-44b8-b00c-72e92659bab5,launched_at=2023-04-14T02:01:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782918df1a6d4a75b6297d6500c71d32',provider_auth='CHAP qJLPzfBh BzNRhqUtxF08H9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:21Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:01:23Z,updated_at=2023-04-14T02:01:23Z,use_quota=True,user_id='7429331394d3492d83fcad4003994687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] detach volume v_37bdde7f-9588-44b8-b00c-72e92659bab5 from target iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5/luns/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5/luns/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5/luns/v_37bdde7f-9588-44b8-b00c-72e92659bab5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5/luns/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] failed to remove resource iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 because of JDSS resource v_37bdde7f-9588-44b8-b00c-72e92659bab5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] delete target: iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] delete target iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] failed to remove resource iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 because of JDSS resource iqn.2010-10.org.openstack:37bdde7f-9588-44b8-b00c-72e92659bab5 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] deleating volume v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] get snapshots for volume v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] get volume v_37bdde7f-9588-44b8-b00c-72e92659bab5 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_37bdde7f-9588-44b8-b00c-72e92659bab5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439090', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111226', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17023112808858238210', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '339481e6f3917486', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293747712', 'san:volume_id': '339481e6f39174861dad17b15183e428d08c8cb4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83403', 'name': 'v_37bdde7f-9588-44b8-b00c-72e92659bab5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] delete volume:v_37bdde7f-9588-44b8-b00c-72e92659bab5 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bdde7f-9588-44b8-b00c-72e92659bab5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] volume v_37bdde7f-9588-44b8-b00c-72e92659bab5 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:01:24 user cinder-volume[73579]: DEBUG cinder.quota [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Created reservations ['cdbc6c49-797d-49dc-963c-d8bde9567e39', '01df681e-0401-408b-a46f-8530031b3793', 'b105e0da-25d6-42c2-9c4e-6a3cce2ac18f', 'cbe6a1e1-9cb0-4d05-91c7-e10bfc536dba'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:01:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:01:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293829632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:01:25 user cinder-volume[73579]: DEBUG cinder.manager [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:01:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Deleted volume successfully. Apr 14 02:01:25 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ee8cd974-a075-4f67-a64c-9c8366055fcf tempest-VolumesTransfersV357Test-1585994790 None] Lock "cinder-37bdde7f-9588-44b8-b00c-72e92659bab5-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=50,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=28,cinder:SELECT=41,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Flow 'volume_create_manager' (1e809d45-9080-4e40-a525-0bc9d64ad79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426f3175-62ae-4c52-b316-56159f4b122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426f3175-62ae-4c52-b316-56159f4b122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1460650346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=11ffaf06-4505-4a71-9dc1-a3555fd1511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df1ae30489146b0840782929277b460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:01:26Z,use_quota=True,user_id='d1058d76de7f4e6abf2951d59a190211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599fa6b5-20ec-4889-9a59-db6a7d673fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599fa6b5-20ec-4889-9a59-db6a7d673fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581feb37-bd69-4210-bf93-6705cc5f4278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581feb37-bd69-4210-bf93-6705cc5f4278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'volume_name': 'volume-11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e90e423-3c84-4180-970c-6446b587d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e90e423-3c84-4180-970c-6446b587d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999d112a-6351-44aa-ae35-a11a5952f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:26 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Volume 11ffaf06-4505-4a71-9dc1-a3555fd1511b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'volume_size': 1} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] creating volume v_11ffaf06-4505-4a71-9dc1-a3555fd1511b. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] create volume {'name': 'v_11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'is_clone': False, 'name': 'v_11ffaf06-4505-4a71-9dc1-a3555fd1511b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999d112a-6351-44aa-ae35-a11a5952f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062befac-d5e5-4f50-8458-d475b2e6e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:27 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Volume volume-11ffaf06-4505-4a71-9dc1-a3555fd1511b (11ffaf06-4505-4a71-9dc1-a3555fd1511b): created successfully Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062befac-d5e5-4f50-8458-d475b2e6e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Flow 'volume_create_manager' (1e809d45-9080-4e40-a525-0bc9d64ad79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ccf7631f-801a-4ad6-8460-dffd2d31eca1 tempest-VolumesTransfersV357Test-1479399365 None] Created volume successfully. Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Acquiring lock "cinder-450914a2-96ae-4c21-a717-2b391be59860-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-450914a2-96ae-4c21-a717-2b391be59860-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] remove_export for volume: 450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1744641460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=450914a2-96ae-4c21-a717-2b391be59860,launched_at=2023-04-14T01:53:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f4117a4adb4aa3b42951cf1fc84237',provider_auth='CHAP XIKaoMjg h6X3AwKMi1ED5y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:58Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:01:28Z,updated_at=2023-04-14T02:01:28Z,use_quota=True,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] detach volume v_450914a2-96ae-4c21-a717-2b391be59860 from target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860/luns/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 because of JDSS resource v_450914a2-96ae-4c21-a717-2b391be59860 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] delete target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] delete target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] failed to remove resource iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 because of JDSS resource iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] deleating volume v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] get snapshots for volume v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] get volume v_450914a2-96ae-4c21-a717-2b391be59860 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_450914a2-96ae-4c21-a717-2b391be59860', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_450914a2-96ae-4c21-a717-2b391be59860', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438588', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '111053', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10528692543993017061', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10145792', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '677087efeb0f91ec', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293747712', 'san:volume_id': '677087efeb0f91ece1508b5726323258e788988f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10145792', 'objsetid': '82371', 'name': 'v_450914a2-96ae-4c21-a717-2b391be59860', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10145792', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] delete snapshot v_450914a2-96ae-4c21-a717-2b391be59860 of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Acquiring lock "cinder-11ffaf06-4505-4a71-9dc1-a3555fd1511b-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.coordination [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Lock "cinder-11ffaf06-4505-4a71-9dc1-a3555fd1511b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] remove_export for volume: 11ffaf06-4505-4a71-9dc1-a3555fd1511b. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1460650346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=11ffaf06-4505-4a71-9dc1-a3555fd1511b,launched_at=2023-04-14T02:01:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df1ae30489146b0840782929277b460',provider_auth='CHAP RtcgNJLl A6zCuhgYq4U0Jo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:26Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:01:29Z,updated_at=2023-04-14T02:01:29Z,use_quota=True,user_id='d1058d76de7f4e6abf2951d59a190211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] detach volume v_11ffaf06-4505-4a71-9dc1-a3555fd1511b from target iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b/luns/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b/luns/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b/luns/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b/luns/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] failed to remove resource iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b because of JDSS resource v_11ffaf06-4505-4a71-9dc1-a3555fd1511b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] delete target: iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] delete target iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] failed to remove resource iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b because of JDSS resource iqn.2010-10.org.openstack:11ffaf06-4505-4a71-9dc1-a3555fd1511b DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] deleating volume v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] get snapshots for volume v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] get volume v_11ffaf06-4505-4a71-9dc1-a3555fd1511b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439096', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111231', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15743371640238634261', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b8d765715f381a3e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303979520', 'san:volume_id': 'b8d765715f381a3e263208c92226dc152cb87057', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83414', 'name': 'v_11ffaf06-4505-4a71-9dc1-a3555fd1511b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] delete volume:v_11ffaf06-4505-4a71-9dc1-a3555fd1511b recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_450914a2-96ae-4c21-a717-2b391be59860 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] snapshot v_450914a2-96ae-4c21-a717-2b391be59860 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.quota [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Created reservations ['5e3394ae-20f7-4a3a-bc9c-5b2ac86e8142', '866b3063-87cc-4b56-842c-4f4dc38f3c39', '0e42b573-9364-4766-8d6b-56984901e0bf', 'a295509d-da1c-455a-aeb9-a9bcb7164aa3'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303979520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.manager [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:01:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Deleted volume successfully. Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d48aa497-14af-436c-b54a-8990ea9b0bf0 tempest-TestVolumeBootPattern-224521177 None] Lock "cinder-450914a2-96ae-4c21-a717-2b391be59860-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11ffaf06-4505-4a71-9dc1-a3555fd1511b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] volume v_11ffaf06-4505-4a71-9dc1-a3555fd1511b deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.quota [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Created reservations ['60e22d86-b288-48f5-b7ac-9dec97cae4f7', '4b50c516-f5f7-422c-9b00-d4eb24fcf2c5', 'd0de7845-3ba0-437e-8b0d-501c41043000', 'e90c42d8-51c3-4e59-a1d8-2cec9f543947'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303979520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:01:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Deleted volume successfully. Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.coordination [None req-58a61c40-b18d-46e1-a2c7-583678626d9f tempest-VolumesTransfersV357Test-1585994790 None] Lock "cinder-11ffaf06-4505-4a71-9dc1-a3555fd1511b-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304073728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:01:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Flow 'volume_create_manager' (e8e6c650-edbb-40cf-806c-54bafc74a63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1eb9b21-f2c0-490f-a80d-f3d83135b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1eb9b21-f2c0-490f-a80d-f3d83135b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1411867537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=33d5047a-5973-4a08-8534-d8a628a6469c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01f022f8794467f85696e7b96f604a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:01:37Z,use_quota=True,user_id='e034e610bfbb45b1ae2bb258c1cb5cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bfb55b-91ce-4b5a-bbbe-1683f54b162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bfb55b-91ce-4b5a-bbbe-1683f54b162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c4edc5-42d9-4c10-a18a-1e1e66413971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c4edc5-42d9-4c10-a18a-1e1e66413971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d5047a-5973-4a08-8534-d8a628a6469c', 'volume_name': 'volume-33d5047a-5973-4a08-8534-d8a628a6469c', 'volume_size': 2}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5524668a-2432-4e34-adaf-66dfc0fe2373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5524668a-2432-4e34-adaf-66dfc0fe2373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae1f65-1d81-4877-8bcc-4e96139d2d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:36 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Volume 33d5047a-5973-4a08-8534-d8a628a6469c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d5047a-5973-4a08-8534-d8a628a6469c', 'volume_size': 2} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] creating volume v_33d5047a-5973-4a08-8534-d8a628a6469c. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] create volume {'name': 'v_33d5047a-5973-4a08-8534-d8a628a6469c', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_33d5047a-5973-4a08-8534-d8a628a6469c', 'is_clone': False, 'name': 'v_33d5047a-5973-4a08-8534-d8a628a6469c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae1f65-1d81-4877-8bcc-4e96139d2d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d5047a-5973-4a08-8534-d8a628a6469c', 'volume_size': 2}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85e2baf-cdc1-4e44-ba9d-db569b1cf991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:37 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Volume volume-33d5047a-5973-4a08-8534-d8a628a6469c (33d5047a-5973-4a08-8534-d8a628a6469c): created successfully Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85e2baf-cdc1-4e44-ba9d-db569b1cf991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Flow 'volume_create_manager' (e8e6c650-edbb-40cf-806c-54bafc74a63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:37 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8d148034-8b49-4cf9-90b9-b79887a1ca6e tempest-VolumesCloneNegativeTest-741861673 None] Created volume successfully. Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Acquiring lock "cinder-33d5047a-5973-4a08-8534-d8a628a6469c-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Lock "cinder-33d5047a-5973-4a08-8534-d8a628a6469c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] remove_export for volume: 33d5047a-5973-4a08-8534-d8a628a6469c. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1411867537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=33d5047a-5973-4a08-8534-d8a628a6469c,launched_at=2023-04-14T02:01:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01f022f8794467f85696e7b96f604a2',provider_auth='CHAP yREnjoCH SYrdwNZqiFXbMQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:37Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:01:38Z,updated_at=2023-04-14T02:01:38Z,use_quota=True,user_id='e034e610bfbb45b1ae2bb258c1cb5cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] detach volume v_33d5047a-5973-4a08-8534-d8a628a6469c from target iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c/luns/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c/luns/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c/luns/v_33d5047a-5973-4a08-8534-d8a628a6469c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c/luns/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] failed to remove resource iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c because of JDSS resource v_33d5047a-5973-4a08-8534-d8a628a6469c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] delete target: iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] delete target iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] failed to remove resource iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c because of JDSS resource iqn.2010-10.org.openstack:33d5047a-5973-4a08-8534-d8a628a6469c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] deleating volume v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] get snapshots for volume v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] get volume v_33d5047a-5973-4a08-8534-d8a628a6469c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_33d5047a-5973-4a08-8534-d8a628a6469c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439106', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111239', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11094569880769256872', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '93886fea30843d1f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303991808', 'san:volume_id': '93886fea30843d1f7eea1ec42502618903a24c50', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83467', 'name': 'v_33d5047a-5973-4a08-8534-d8a628a6469c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] delete volume:v_33d5047a-5973-4a08-8534-d8a628a6469c recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33d5047a-5973-4a08-8534-d8a628a6469c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] volume v_33d5047a-5973-4a08-8534-d8a628a6469c deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.quota [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Created reservations ['3b837201-5fae-43a8-9366-ad8d44d5c2e3', 'e38f56ff-71ec-4315-a968-04816e577fda', 'bf45d742-2aed-4260-a8c3-b2da60ac8647', 'd6b10849-9e06-4cad-accd-f69d97aa602e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Flow 'volume_create_manager' (6a18508f-4c17-49e9-8e48-76472f4aa633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19148f0c-1f44-45e2-be35-fb9ae2d98bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19148f0c-1f44-45e2-be35-fb9ae2d98bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1113854014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=06b73a5e-5178-4561-af91-11e1028d2238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:01:40Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caeb3910-4ab2-423b-a674-5cb41f4b67b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caeb3910-4ab2-423b-a674-5cb41f4b67b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30884098-1722-4572-b4a8-ebb2c6025ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30884098-1722-4572-b4a8-ebb2c6025ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06b73a5e-5178-4561-af91-11e1028d2238', 'volume_name': 'volume-06b73a5e-5178-4561-af91-11e1028d2238', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3df06d-0bf3-4a7a-8265-f20c813e3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3df06d-0bf3-4a7a-8265-f20c813e3256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b6f4c5-6eff-491f-ab6f-1e690a20bec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:40 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Volume 06b73a5e-5178-4561-af91-11e1028d2238: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06b73a5e-5178-4561-af91-11e1028d2238', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Cloning 06b73a5e-5178-4561-af91-11e1028d2238 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 2, 1, 40, 734959)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.034s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 2, 1, 40, 764011)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] create snapshot v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304073728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.manager [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:01:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Deleted volume successfully. Apr 14 02:01:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3753098a-a653-4166-844b-cb8567e56a98 tempest-VolumesCloneNegativeTest-741861673 None] Lock "cinder-33d5047a-5973-4a08-8534-d8a628a6469c-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_06b73a5e-5178-4561-af91-11e1028d2238'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] create volume v_06b73a5e-5178-4561-af91-11e1028d2238 from snapshot v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:01:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_06b73a5e-5178-4561-af91-11e1028d2238', 'is_clone': True, 'full_name': 'Pool-0/v_06b73a5e-5178-4561-af91-11e1028d2238', 'name': 'v_06b73a5e-5178-4561-af91-11e1028d2238'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] get volume v_06b73a5e-5178-4561-af91-11e1028d2238 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_06b73a5e-5178-4561-af91-11e1028d2238', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_06b73a5e-5178-4561-af91-11e1028d2238', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439111', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111246', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '561453614735302866', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4f0ba6fcc48ee1f6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304024576', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81393', 'name': 'v_06b73a5e-5178-4561-af91-11e1028d2238', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Marking volume 06b73a5e-5178-4561-af91-11e1028d2238 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Creating volume glance metadata for volume 06b73a5e-5178-4561-af91-11e1028d2238 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=56,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=10 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=32,cinder:SELECT=57,cinder:INSERT=11 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b6f4c5-6eff-491f-ab6f-1e690a20bec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b73a5e-5178-4561-af91-11e1028d2238', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5581862f-9e76-40c2-8c15-150cf4968fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:42 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Volume volume-06b73a5e-5178-4561-af91-11e1028d2238 (06b73a5e-5178-4561-af91-11e1028d2238): created successfully Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5581862f-9e76-40c2-8c15-150cf4968fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Flow 'volume_create_manager' (6a18508f-4c17-49e9-8e48-76472f4aa633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4f067c38-892f-43ff-a1ef-5402e3c78156 tempest-ServerActionsTestJSON-2035821517 None] Created volume successfully. Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Flow 'volume_create_manager' (7fbc38b4-d02d-4bac-940c-6c266f12fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b29987-eb8f-4100-a159-ee542ec51c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b29987-eb8f-4100-a159-ee542ec51c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-843101673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9541f10-18f5-4733-bb1c-67b444f4feab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d76a99b14947e0ae88602e968a31a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:01:43Z,use_quota=True,user_id='be42447528514bfe965df0255fa33427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498afe55-39ad-4d64-9f55-6ba690429ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498afe55-39ad-4d64-9f55-6ba690429ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c9b844-93fe-43fb-8ed9-396c9cb9483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c9b844-93fe-43fb-8ed9-396c9cb9483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9541f10-18f5-4733-bb1c-67b444f4feab', 'volume_name': 'volume-f9541f10-18f5-4733-bb1c-67b444f4feab', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c167df7-3b9a-4438-87c8-027fc18ec9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c167df7-3b9a-4438-87c8-027fc18ec9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46ecf2c-3f66-4fdf-8bc2-dd9ad669d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Volume f9541f10-18f5-4733-bb1c-67b444f4feab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9541f10-18f5-4733-bb1c-67b444f4feab', 'volume_size': 1} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] creating volume v_f9541f10-18f5-4733-bb1c-67b444f4feab. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] create volume {'name': 'v_f9541f10-18f5-4733-bb1c-67b444f4feab', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Flow 'volume_create_manager' (524a27c7-67c6-4135-ab9b-6d899c5d67bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495c4027-78e0-477c-b33a-c983fe33b273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495c4027-78e0-477c-b33a-c983fe33b273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3096adae-4f81-4e5f-b41e-453c2656a2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39a9c4a0ec24de08c0217e32890488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:01:43Z,use_quota=True,user_id='11a703fbca99487897966a7ccadb533e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fddb1c85-4879-43ef-8613-ce5b910fbcdb),volume_type_id=fddb1c85-4879-43ef-8613-ce5b910fbcdb)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53503f1-c612-42e4-8e88-e1b08e038192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53503f1-c612-42e4-8e88-e1b08e038192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d390cb9-a25e-4491-9c9b-5c2925c8d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d390cb9-a25e-4491-9c9b-5c2925c8d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3096adae-4f81-4e5f-b41e-453c2656a2bb', 'volume_name': 'volume-3096adae-4f81-4e5f-b41e-453c2656a2bb', 'volume_size': 1, 'image_id': '2743d171-521e-4858-8bd6-121947994874', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf0cf05afc6391b98df66f587a123ee9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39a9c4a0ec24de08c0217e32890488e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad26fb118ee47beb366c01b5cf6316956153c2fe1d6d4d40c1db46ebbbb1edefaa35cd532d47a84de02c32846dff69c526f64c4a012a597b5b89b294754d4c91', 'id': '2743d171-521e-4858-8bd6-121947994874', 'created_at': datetime.datetime(2023, 4, 14, 2, 1, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 1, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2743d171-521e-4858-8bd6-121947994874/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b70ae6-4e98-45cd-9eb3-a3548adc4b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b70ae6-4e98-45cd-9eb3-a3548adc4b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beecd66a-1311-4790-8c31-25355ce16103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Volume 3096adae-4f81-4e5f-b41e-453c2656a2bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3096adae-4f81-4e5f-b41e-453c2656a2bb', 'volume_size': 1, 'image_id': '2743d171-521e-4858-8bd6-121947994874', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf0cf05afc6391b98df66f587a123ee9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39a9c4a0ec24de08c0217e32890488e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad26fb118ee47beb366c01b5cf6316956153c2fe1d6d4d40c1db46ebbbb1edefaa35cd532d47a84de02c32846dff69c526f64c4a012a597b5b89b294754d4c91', 'id': '2743d171-521e-4858-8bd6-121947994874', 'created_at': datetime.datetime(2023, 4, 14, 2, 1, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 1, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2743d171-521e-4858-8bd6-121947994874/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Cloning 3096adae-4f81-4e5f-b41e-453c2656a2bb from image 2743d171-521e-4858-8bd6-121947994874 at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Acquiring lock "cinder-2743d171-521e-4858-8bd6-121947994874" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "cinder-2743d171-521e-4858-8bd6-121947994874" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Preparing cache entry for image = 2743d171-521e-4858-8bd6-121947994874 on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Attempting to retrieve cache entry for image = 2743d171-521e-4858-8bd6-121947994874 on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2, size 0.00 MB, duration 1.00 sec {{(pid=73579) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 02:01:43 user cinder-volume[73579]: INFO cinder.image.image_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Image download 0.00 MB at 0.00 MB/s Apr 14 02:01:43 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:43 user sudo[96903]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 Apr 14 02:01:43 user sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab', 'is_clone': False, 'name': 'v_f9541f10-18f5-4733-bb1c-67b444f4feab'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46ecf2c-3f66-4fdf-8bc2-dd9ad669d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9541f10-18f5-4733-bb1c-67b444f4feab', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c50e83-92b1-46a5-9f19-9063dbca67ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:01:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Volume volume-f9541f10-18f5-4733-bb1c-67b444f4feab (f9541f10-18f5-4733-bb1c-67b444f4feab): created successfully Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c50e83-92b1-46a5-9f19-9063dbca67ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:01:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Flow 'volume_create_manager' (7fbc38b4-d02d-4bac-940c-6c266f12fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:01:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2a48d321-f1f4-4461-9d3e-23cf8f1b5127 tempest-VolumesSnapshotListTestJSON-1041625499 None] Created volume successfully. Apr 14 02:01:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] create snapshot 407f7380-1137-4302-98e0-7d79eeda2ecf for volume f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:01:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] cloning v_f9541f10-18f5-4733-bb1c-67b444f4feab to s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:01:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] create snapshot s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:01:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:44 user sudo[96903]: pam_unix(sudo:session): session closed for user root Apr 14 02:01:44 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2" returned: 0 in 0.883s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:44 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Temporary image 2743d171-521e-4858-8bd6-121947994874 is fetched for user 11a703fbca99487897966a7ccadb533e. {{(pid=73579) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 02:01:44 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:44 user sudo[96910]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 Apr 14 02:01:44 user sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:01:45 user sudo[96910]: pam_unix(sudo:session): session closed for user root Apr 14 02:01:45 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2" returned: 0 in 0.815s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] creating volume v_3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] create volume {'name': 'v_3096adae-4f81-4e5f-b41e-453c2656a2bb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_407f7380-1137-4302-98e0-7d79eeda2ecf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] create volume s_407f7380-1137-4302-98e0-7d79eeda2ecf from snapshot s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] create export for volume: 06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] ensure volume 06b73a5e-5178-4561-af91-11e1028d2238 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] check if targe iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3096adae-4f81-4e5f-b41e-453c2656a2bb', 'is_clone': False, 'name': 'v_3096adae-4f81-4e5f-b41e-453c2656a2bb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Attempting download of 2743d171-521e-4858-8bd6-121947994874 ((None, None)) to volume 3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] copy_image_to_volume volume-3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG os_brick.utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] create target and attach volume 06b73a5e-5178-4561-af91-11e1028d2238 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] create target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6507cb-753b-4fe9-8208-0bca2aa3fa2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fc4853-904e-4bf6-a4a6-d143d9ad8801]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216e837-74eb-4007-8254-6f7273662904]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d8a70-921b-48a9-bed3-685b0a0eef85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): nvme version {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] 'nvme version' failed. Not Retrying. {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] nvme not present on system {{(pid=73579) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 02:01:46 user cinder-volume[73579]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 02:01:46 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8f9d27-7320-4ba6-9855-99d56aa54ee2]: (4, '') {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73579) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73579) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.lightos [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] LIGHTOS: no hostnqn found. {{(pid=73579) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG os_brick.utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Volume 3096adae-4f81-4e5f-b41e-453c2656a2bb: creating export {{(pid=73579) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] create export for volume: 3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] ensure volume 3096adae-4f81-4e5f-b41e-453c2656a2bb assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] check if targe iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab@s_407f7380-1137-4302-98e0-7d79eeda2ecf', 'is_clone': True, 'full_name': 'Pool-0/s_407f7380-1137-4302-98e0-7d79eeda2ecf', 'name': 's_407f7380-1137-4302-98e0-7d79eeda2ecf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] volume s_407f7380-1137-4302-98e0-7d79eeda2ecf properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:01:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-abf8f537-e911-4842-a343-fc860729e51e tempest-VolumesSnapshotListTestJSON-1041625499 None] Create snapshot completed successfully Apr 14 02:01:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] create snapshot 1c026374-a8e0-4d9d-8289-60116d7be008 for volume f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:01:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] cloning v_f9541f10-18f5-4733-bb1c-67b444f4feab to s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:01:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] create snapshot s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:01:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_1c026374-a8e0-4d9d-8289-60116d7be008'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] create volume s_1c026374-a8e0-4d9d-8289-60116d7be008 from snapshot s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] atach volume v_06b73a5e-5178-4561-af91-11e1028d2238 to target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] create target and attach volume 3096adae-4f81-4e5f-b41e-453c2656a2bb to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] create target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab@s_1c026374-a8e0-4d9d-8289-60116d7be008', 'is_clone': True, 'full_name': 'Pool-0/s_1c026374-a8e0-4d9d-8289-60116d7be008', 'name': 's_1c026374-a8e0-4d9d-8289-60116d7be008'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] volume s_1c026374-a8e0-4d9d-8289-60116d7be008 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:01:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-11243958-c032-42b7-b072-b6fdd450b3fd tempest-VolumesSnapshotListTestJSON-1041625499 None] Create snapshot completed successfully Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] create snapshot ebd850d5-e97e-48b2-8f89-843f784c15d9 for volume f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] cloning v_f9541f10-18f5-4733-bb1c-67b444f4feab to s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] create snapshot s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3466306261366663', 'lun': 0, 'mode': 'wt', 'name': 'v_06b73a5e-5178-4561-af91-11e1028d2238', 'prod_id': 'Storage', 'scsi_id': '4f0ba6fcc48ee1f6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] add credentails to target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ebd850d5-e97e-48b2-8f89-843f784c15d9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] create volume s_ebd850d5-e97e-48b2-8f89-843f784c15d9 from snapshot s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab@s_ebd850d5-e97e-48b2-8f89-843f784c15d9', 'is_clone': True, 'full_name': 'Pool-0/s_ebd850d5-e97e-48b2-8f89-843f784c15d9', 'name': 's_ebd850d5-e97e-48b2-8f89-843f784c15d9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] volume s_ebd850d5-e97e-48b2-8f89-843f784c15d9 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:01:51 user cinder-volume[73579]: INFO cinder.volume.manager [None req-eecf32f4-ed4b-4ec1-beea-19afb41989f6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Create snapshot completed successfully Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] atach volume v_3096adae-4f81-4e5f-b41e-453c2656a2bb to target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HBVCXlJa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] initialize_connection for 06b73a5e-5178-4561-af91-11e1028d2238 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.coordination [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Acquiring lock "cinder-ebd850d5-e97e-48b2-8f89-843f784c15d9-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.coordination [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-ebd850d5-e97e-48b2-8f89-843f784c15d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] deleating snapshot s_ebd850d5-e97e-48b2-8f89-843f784c15d9. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] get snapshots for volume s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'f932be5d-eab5-4d37-aaba-5e5df63df9f6'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:01:52 user cinder-volume[73579]: INFO cinder.volume.manager [req-4aaef0ce-ac16-4469-84d1-c561aa585b26 req-b97fbebe-3af4-40ec-9407-f8de778499ef tempest-ServerActionsTestJSON-2035821517 None] attachment_update completed successfully. Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6363656534353866', 'lun': 0, 'mode': 'wt', 'name': 'v_3096adae-4f81-4e5f-b41e-453c2656a2bb', 'prod_id': 'Storage', 'scsi_id': 'ccee458f62f6ce39'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] add credentails to target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] get volume s_ebd850d5-e97e-48b2-8f89-843f784c15d9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 201, 'error': None, 'data': {'name': 'eVMLmGyI'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] initialize_connection for 3096adae-4f81-4e5f-b41e-453c2656a2bb 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connector [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Factory for iscsi on None {{(pid=73579) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMLmGyI', 'auth_password': '***', 'target_lun': False}}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 02:01:54 user cinder-volume[73579]: INFO os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae3feb6-17af-4c2f-a919-cf768afd5a2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 02:01:54 user cinder-volume[73579]: {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --interface default --op new {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab@s_ebd850d5-e97e-48b2-8f89-843f784c15d9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ebd850d5-e97e-48b2-8f89-843f784c15d9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439120', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111276', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3857420729554356947', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '694586fb2e22f6e5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303774720', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83594', 'name': 's_ebd850d5-e97e-48b2-8f89-843f784c15d9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] delete snapshot s_ebd850d5-e97e-48b2-8f89-843f784c15d9 of volume v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a06cba2-8601-446b-b69b-a93fe3d39fc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb] added\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb] added Apr 14 02:01:54 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bc5f69-b713-4420-bb07-3dac7de0bd40]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[106bee48-6ad7-49ac-8f74-59d278601d1b]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVMLmGyI {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVMLmGyI" returned: 0 in 0.017s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[284f219b-24d1-4361-a17a-c6b03746c7e1]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVMLmGyI'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[31607971-f51f-40b0-8489-facedf4783e1]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:54 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aac733-1015-41b8-9e43-3715c5326fb9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash) Apr 14 02:01:55 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash) Apr 14 02:01:55 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --login {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b3d98-335d-40b9-9cdd-970017a127a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260] Apr 14 02:01:55 user cinder-volume[73579]: Login to [iface: default, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260] successful. Apr 14 02:01:55 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[b855d780-8786-49e8-bffd-bf85bea78816]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b0b823-87c3-4439-81db-bce565d7ff11]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash) Apr 14 02:01:55 user cinder-volume[73579]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb (non-flash) Apr 14 02:01:55 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash) Apr 14 02:01:55 user cinder-volume[73579]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb (non-flash) Apr 14 02:01:55 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Connected to 172.16.0.220:3260 {{(pid=73579) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=73579) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Scanning host 34 c: -, t: -, l: 0) {{(pid=73579) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0ab9b-2e13-44d1-92fa-99f730ce6de8]: (4, ('- - 0', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:55 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=73579) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73579) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMLmGyI', 'auth_password': '***', 'target_lun': False} {{(pid=73579) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26363656534353866', 'path': '/dev/sdc'} {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdc of=/dev/null count=1 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdc of=/dev/null count=1" returned: 0 in 0.028s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[542f332b-19d6-4efe-95f0-ef5db36c8ce1]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00205227 s, 249 kB/s\n')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_2743d171-521e-4858-8bd6-121947994874_m1p18g2x {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:56 user sudo[97103]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_2743d171-521e-4858-8bd6-121947994874_m1p18g2x Apr 14 02:01:56 user sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:01:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_ebd850d5-e97e-48b2-8f89-843f784c15d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] snapshot s_ebd850d5-e97e-48b2-8f89-843f784c15d9 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG cinder.quota [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Created reservations ['00ec34c3-3fd3-488a-85f9-ed9dddc45a9b', '2bd07b3e-796a-4cc8-9238-42f37fccca8c', '5973bb01-6ee1-479f-a5a7-e2266ba792ce', 'ee44f328-1989-4a0f-bb33-1ccfecc044a2'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:56 user cinder-volume[73579]: INFO cinder.volume.manager [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Delete snapshot completed successfully. Apr 14 02:01:56 user cinder-volume[73579]: DEBUG cinder.coordination [None req-01eaa923-8437-455e-8e28-be8f21d566ca tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-ebd850d5-e97e-48b2-8f89-843f784c15d9-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:01:56 user sudo[97103]: pam_unix(sudo:session): session closed for user root Apr 14 02:01:56 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_2743d171-521e-4858-8bd6-121947994874_m1p18g2x" returned: 0 in 0.755s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:56 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:57 user sudo[97117]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 Apr 14 02:01:57 user sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Acquiring lock "cinder-1c026374-a8e0-4d9d-8289-60116d7be008-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-1c026374-a8e0-4d9d-8289-60116d7be008-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] deleating snapshot s_1c026374-a8e0-4d9d-8289-60116d7be008. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] get snapshots for volume s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] get volume s_1c026374-a8e0-4d9d-8289-60116d7be008 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:57 user sudo[97117]: pam_unix(sudo:session): session closed for user root Apr 14 02:01:57 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2" returned: 0 in 0.748s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] 2743d171-521e-4858-8bd6-121947994874 was raw, converting to raw {{(pid=73579) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 of=/dev/sdc oflag=direct {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:57 user sudo[97122]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 of=/dev/sdc oflag=direct Apr 14 02:01:57 user sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab@s_1c026374-a8e0-4d9d-8289-60116d7be008', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_1c026374-a8e0-4d9d-8289-60116d7be008', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439118', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111266', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14224869245063334284', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '99ca2fc924994e7c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303787008', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82554', 'name': 's_1c026374-a8e0-4d9d-8289-60116d7be008', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] delete snapshot s_1c026374-a8e0-4d9d-8289-60116d7be008 of volume v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:01:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:01:58 user sudo[97122]: pam_unix(sudo:session): session closed for user root Apr 14 02:01:58 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 of=/dev/sdc oflag=direct" returned: 0 in 0.701s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:58 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 /dev/sdc {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:58 user sudo[97131]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 /dev/sdc Apr 14 02:01:58 user sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:01:59 user sudo[97131]: pam_unix(sudo:session): session closed for user root Apr 14 02:01:59 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 /dev/sdc" returned: 0 in 0.840s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:01:59 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:01:59 user sudo[97148]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2 Apr 14 02:01:59 user sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:01:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_1c026374-a8e0-4d9d-8289-60116d7be008 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:01:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] snapshot s_1c026374-a8e0-4d9d-8289-60116d7be008 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:01:59 user cinder-volume[73579]: DEBUG cinder.quota [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Created reservations ['c2f06268-aff4-4f80-aa41-89df35df27fe', 'ee706741-10f3-4b6c-974a-cba48a9d49f8', '551316a0-d7d1-45a8-9846-7d32e09b5460', '47ed52f9-1224-407a-a3f6-e9bdd1ceee91'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:01:59 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Delete snapshot completed successfully. Apr 14 02:01:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3bc850d0-e2a3-4516-8d8b-1058ca4ed53f tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-1c026374-a8e0-4d9d-8289-60116d7be008-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:02:00 user sudo[97148]: pam_unix(sudo:session): session closed for user root Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2" returned: 0 in 0.777s {{(pid=73579) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2743d171-521e-4858-8bd6-121947994874_d9wzx2ebuser@joviandss-2, size 0.00 MB, duration 1.00 sec, destination /dev/sdc {{(pid=73579) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 02:02:00 user cinder-volume[73579]: INFO cinder.image.image_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Converted 0.00 MB image at 0.00 MB/s Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMLmGyI', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '26363656534353866', 'path': '/dev/sdc'}), 'kwargs': {'force': False}}" {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6753510-8bfc-4ca0-be63-e5d2e5f4ffd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 02:02:00 user cinder-volume[73579]: No targets found. Apr 14 02:02:00 user cinder-volume[73579]: iSNS: Apr 14 02:02:00 user cinder-volume[73579]: No targets found. Apr 14 02:02:00 user cinder-volume[73579]: STATIC: Apr 14 02:02:00 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 Apr 14 02:02:00 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 02:02:00 user cinder-volume[73579]: Iface Name: default Apr 14 02:02:00 user cinder-volume[73579]: Target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb Apr 14 02:02:00 user cinder-volume[73579]: Portal: 172.16.0.220:3260,-1 Apr 14 02:02:00 user cinder-volume[73579]: Iface Name: default Apr 14 02:02:00 user cinder-volume[73579]: FIRMWARE: Apr 14 02:02:00 user cinder-volume[73579]: No targets found. Apr 14 02:02:00 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 02:02:00 user cinder-volume[73579]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 02:02:00 user cinder-volume[73579]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73579) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb', 0)] {{(pid=73579) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[050cf897-8b83-4b65-80ca-fff9dcf3cd6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffada3d-f01d-433d-8644-4c87f53d073b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb (non-flash)\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash) Apr 14 02:02:00 user cinder-volume[73579]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb (non-flash) Apr 14 02:02:00 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash) Apr 14 02:02:00 user cinder-volume[73579]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb (non-flash) Apr 14 02:02:00 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Resulting device map defaultdict(. at 0x7f9f6f30e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb'): ({'sdc'}, set())}) {{(pid=73579) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Removing single pathed devices sdc {{(pid=73579) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e9646c-fdda-4a1b-b08e-0083dd8365df]: (4, ('path checker states:\nup 2\n\npaths: 0\nbusy: False\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c22d59-e9e8-45fb-b0c8-681068106897]: (4, ('ok\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Flushing IO for device /dev/sdc {{(pid=73579) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba841448-60fe-48d1-b8da-5501aaf63f44]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73579) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db20cf-bc84-4d30-b034-01a21580e39f]: (4, ('1', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=73579) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.linuxscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] SCSI volumes sdc have been removed. {{(pid=73579) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb')] {{(pid=73579) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a36fa8-8872-4ff4-a9f5-e317e31c17bf]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --logout {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Acquiring lock "cinder-407f7380-1137-4302-98e0-7d79eeda2ecf-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac5f6ae-5247-4a90-a8b9-26526b2de51b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260] Apr 14 02:02:00 user cinder-volume[73579]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb, portal: 172.16.0.220,3260] successful. Apr 14 02:02:00 user cinder-volume[73579]: stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op delete {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-407f7380-1137-4302-98e0-7d79eeda2ecf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] deleating snapshot s_407f7380-1137-4302-98e0-7d79eeda2ecf. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] get snapshots for volume s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=80440) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ab8bb4-42ff-4085-b62e-df274ab122be]: (4, ('', '')) {{(pid=80440) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73579) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.base [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73579) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] <== disconnect_volume: return (299ms) None {{(pid=73579) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] terminate connection for 3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.driver [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] volume 3096adae-4f81-4e5f-b41e-453c2656a2bb: removing export {{(pid=73579) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] remove_export for volume: 3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3096adae-4f81-4e5f-b41e-453c2656a2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39a9c4a0ec24de08c0217e32890488e',provider_auth='CHAP eVMLmGyI CTVXbxEB803uPo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T02:01:43Z,use_quota=True,user_id='11a703fbca99487897966a7ccadb533e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fddb1c85-4879-43ef-8613-ce5b910fbcdb),volume_type_id=fddb1c85-4879-43ef-8613-ce5b910fbcdb) from target:iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] detach volume v_3096adae-4f81-4e5f-b41e-453c2656a2bb from target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] delete target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] delete target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] get volume s_407f7380-1137-4302-98e0-7d79eeda2ecf info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab@s_407f7380-1137-4302-98e0-7d79eeda2ecf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_407f7380-1137-4302-98e0-7d79eeda2ecf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439114', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111256', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10191625754386134231', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5ac52061895753b8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303795200', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83432', 'name': 's_407f7380-1137-4302-98e0-7d79eeda2ecf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] delete snapshot s_407f7380-1137-4302-98e0-7d79eeda2ecf of volume v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Downloaded image 2743d171-521e-4858-8bd6-121947994874 ((None, None)) to volume 3096adae-4f81-4e5f-b41e-453c2656a2bb successfully. {{(pid=73579) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.image.image_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Temporary image 2743d171-521e-4858-8bd6-121947994874 for user 11a703fbca99487897966a7ccadb533e is deleted. {{(pid=73579) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 02:02:01 user cinder-volume[73579]: WARNING cinder.quota [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:02:01 user cinder-volume[73579]: WARNING cinder.quota [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:02:01 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=65,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=69,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.quota [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Created reservations ['80821326-84b7-4337-99e0-432d2d958282', '7bb1adde-dd94-4049-8458-7f7730621b3b', '1259067b-7c9e-45e8-9ce8-392f0ba4f35d', '76ae4225-e465-486c-8666-21f6e43b4fc7'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Creating image volume entry: {'provider_id': None, 'volume_metadata': [], 'encryption_key_id': None, 'replication_driver_data': None, 'updated_at': datetime.datetime(2023, 4, 14, 2, 1, 43, tzinfo=datetime.timezone.utc), 'deleted': False, 'provider_geometry': None, 'consistencygroup_id': None, 'volume_admin_metadata': [], 'metadata': {}, 'replication_extended_status': None, 'group_id': None, 'display_description': None, 'deleted_at': None, 'project_id': '09d20380b49e4ac2a78e44d2973ed7ce', 'display_name': 'image-2743d171-521e-4858-8bd6-121947994874', 'terminated_at': None, 'shared_targets': True, 'cluster_name': None, 'scheduled_at': datetime.datetime(2023, 4, 14, 2, 1, 43, tzinfo=datetime.timezone.utc), 'availability_zone': 'nova', 'bootable': False, 'created_at': datetime.datetime(2023, 4, 14, 2, 1, 43, tzinfo=datetime.timezone.utc), 'multiattach': False, 'service_uuid': None, 'volume_type_id': 'fddb1c85-4879-43ef-8613-ce5b910fbcdb', 'launched_at': None, 'ec2_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb 0', 'size': 1, 'user_id': '11a703fbca99487897966a7ccadb533e', 'replication_status': None, 'host': 'user@joviandss-2#joviandss-2', 'previous_status': None, 'provider_auth': 'CHAP eVMLmGyI CTVXbxEB803uPo', 'attach_status': 'detached', 'status': 'creating', 'source_volid': '3096adae-4f81-4e5f-b41e-453c2656a2bb'}. {{(pid=73579) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Volume reschedule parameters: False retry: None {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Flow 'volume_create_manager' (13c31e10-639b-4cea-ab8b-441dbe5d38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c5fb18-ec4f-4fec-8fa0-431e18393c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c5fb18-ec4f-4fec-8fa0-431e18393c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='image-2743d171-521e-4858-8bd6-121947994874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5142b1a2-8395-4b00-90ee-33ee973eb5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d20380b49e4ac2a78e44d2973ed7ce',provider_auth='CHAP eVMLmGyI CTVXbxEB803uPo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3096adae-4f81-4e5f-b41e-453c2656a2bb,status='creating',terminated_at=None,updated_at=2023-04-14T02:01:43Z,use_quota=True,user_id='11a703fbca99487897966a7ccadb533e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fddb1c85-4879-43ef-8613-ce5b910fbcdb),volume_type_id=fddb1c85-4879-43ef-8613-ce5b910fbcdb)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09030150-f8b5-48de-9ad7-d24a46248c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09030150-f8b5-48de-9ad7-d24a46248c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b0c491-93c4-4938-98e6-352f3b167169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b0c491-93c4-4938-98e6-352f3b167169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'volume_name': 'volume-5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'volume_size': 1, 'source_volid': '3096adae-4f81-4e5f-b41e-453c2656a2bb', 'source_volstatus': 'downloading'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55975f41-ae7c-49df-9320-2e964f3bd899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55975f41-ae7c-49df-9320-2e964f3bd899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd3141-ecf8-4e92-b350-4a5fa02a388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:01 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Volume 5142b1a2-8395-4b00-90ee-33ee973eb5b9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'volume_size': 1, 'source_volid': '3096adae-4f81-4e5f-b41e-453c2656a2bb', 'source_volstatus': 'downloading'} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] cloned volume 3096adae-4f81-4e5f-b41e-453c2656a2bb to 5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] cloning v_3096adae-4f81-4e5f-b41e-453c2656a2bb to v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] create snapshot v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_5142b1a2-8395-4b00-90ee-33ee973eb5b9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] create volume v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 from snapshot v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots/s_407f7380-1137-4302-98e0-7d79eeda2ecf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] snapshot s_407f7380-1137-4302-98e0-7d79eeda2ecf deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.quota [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Created reservations ['f9a9cd6f-c943-4421-bf1a-a6b296d1c8b9', 'baec55b3-dc74-423f-b4e0-d05e9ebbdef7', '892bac33-0407-44ce-a450-08fbc8e45fad', '0ea435aa-cc3f-42f8-8c48-f10ea9693de7'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:02:02 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Delete snapshot completed successfully. Apr 14 02:02:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e92bad92-b4ca-44c5-9bc6-e0bf17e5aa47 tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-407f7380-1137-4302-98e0-7d79eeda2ecf-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3096adae-4f81-4e5f-b41e-453c2656a2bb@v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'is_clone': True, 'full_name': 'Pool-0/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'name': 'v_5142b1a2-8395-4b00-90ee-33ee973eb5b9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] get volume v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3096adae-4f81-4e5f-b41e-453c2656a2bb@v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439132', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '111303', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14463042585542114598', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3b74ce353e0a475c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303750144', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '82907', 'name': 'v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd3141-ecf8-4e92-b350-4a5fa02a388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'volume_size': 1, 'source_volid': '3096adae-4f81-4e5f-b41e-453c2656a2bb', 'source_volstatus': 'downloading'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790f5774-3cd8-431c-810e-e5e158246e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Acquiring lock "cinder-f9541f10-18f5-4733-bb1c-67b444f4feab-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-f9541f10-18f5-4733-bb1c-67b444f4feab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:02:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Volume volume-5142b1a2-8395-4b00-90ee-33ee973eb5b9 (5142b1a2-8395-4b00-90ee-33ee973eb5b9): created successfully Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790f5774-3cd8-431c-810e-e5e158246e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Flow 'volume_create_manager' (13c31e10-639b-4cea-ab8b-441dbe5d38fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Created volume successfully. Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] remove_export for volume: f9541f10-18f5-4733-bb1c-67b444f4feab. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-843101673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9541f10-18f5-4733-bb1c-67b444f4feab,launched_at=2023-04-14T02:01:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d76a99b14947e0ae88602e968a31a0',provider_auth='CHAP PYkzEBWb jBFrvus2kDLMc8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:02:04Z,updated_at=2023-04-14T02:02:04Z,use_quota=True,user_id='be42447528514bfe965df0255fa33427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] detach volume v_f9541f10-18f5-4733-bb1c-67b444f4feab from target iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab/luns/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab/luns/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Creating new image-volume cache entry for image 2743d171-521e-4858-8bd6-121947994874 on user@joviandss-2#joviandss-2 {{(pid=73579) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] New image-volume cache entry created: {'id': 2, 'image_id': '2743d171-521e-4858-8bd6-121947994874', 'volume_id': '5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 1, 43), 'last_used': datetime.datetime(2023, 4, 14, 2, 2, 3, 673949)}. {{(pid=73579) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "cinder-2743d171-521e-4858-8bd6-121947994874" released by "_prepare_image_cache_entry" :: held 20.342s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Marking volume 3096adae-4f81-4e5f-b41e-453c2656a2bb as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Copying metadata from image 2743d171-521e-4858-8bd6-121947994874 to 3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Creating volume glance metadata for volume 3096adae-4f81-4e5f-b41e-453c2656a2bb backed by image 2743d171-521e-4858-8bd6-121947994874 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2743d171-521e-4858-8bd6-121947994874', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cf0cf05afc6391b98df66f587a123ee9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab/luns/v_f9541f10-18f5-4733-bb1c-67b444f4feab'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab/luns/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] failed to remove resource iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab because of JDSS resource v_f9541f10-18f5-4733-bb1c-67b444f4feab DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] delete target: iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] delete target iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] failed to remove resource iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab because of JDSS resource iqn.2010-10.org.openstack:f9541f10-18f5-4733-bb1c-67b444f4feab DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] deleating volume v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] get snapshots for volume v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beecd66a-1311-4790-8c31-25355ce16103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3096adae-4f81-4e5f-b41e-453c2656a2bb', 'volume_size': 1, 'image_id': '2743d171-521e-4858-8bd6-121947994874', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf0cf05afc6391b98df66f587a123ee9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39a9c4a0ec24de08c0217e32890488e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad26fb118ee47beb366c01b5cf6316956153c2fe1d6d4d40c1db46ebbbb1edefaa35cd532d47a84de02c32846dff69c526f64c4a012a597b5b89b294754d4c91', 'id': '2743d171-521e-4858-8bd6-121947994874', 'created_at': datetime.datetime(2023, 4, 14, 2, 1, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 1, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2743d171-521e-4858-8bd6-121947994874/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc4c2ab-c4bd-428a-b531-d5f3aea5dc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Volume volume-3096adae-4f81-4e5f-b41e-453c2656a2bb (3096adae-4f81-4e5f-b41e-453c2656a2bb): created successfully Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc4c2ab-c4bd-428a-b531-d5f3aea5dc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Flow 'volume_create_manager' (524a27c7-67c6-4135-ab9b-6d899c5d67bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ff970a36-244f-4fed-a650-317d7bbef231 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Created volume successfully. Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] get volume v_f9541f10-18f5-4733-bb1c-67b444f4feab info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f9541f10-18f5-4733-bb1c-67b444f4feab', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439112', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111250', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9569968368140032151', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3dccddde4166eee7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303737856', 'san:volume_id': '3dccddde4166eee78227d80a5b29d865e4f9aac3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83423', 'name': 'v_f9541f10-18f5-4733-bb1c-67b444f4feab', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] delete volume:v_f9541f10-18f5-4733-bb1c-67b444f4feab recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Acquiring lock "cinder-3096adae-4f81-4e5f-b41e-453c2656a2bb-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "cinder-3096adae-4f81-4e5f-b41e-453c2656a2bb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] remove_export for volume: 3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3096adae-4f81-4e5f-b41e-453c2656a2bb,launched_at=2023-04-14T02:02:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39a9c4a0ec24de08c0217e32890488e',provider_auth='CHAP eVMLmGyI CTVXbxEB803uPo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:02:04Z,updated_at=2023-04-14T02:02:04Z,use_quota=True,user_id='11a703fbca99487897966a7ccadb533e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fddb1c85-4879-43ef-8613-ce5b910fbcdb),volume_type_id=fddb1c85-4879-43ef-8613-ce5b910fbcdb) from target:iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] detach volume v_3096adae-4f81-4e5f-b41e-453c2656a2bb from target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns/v_3096adae-4f81-4e5f-b41e-453c2656a2bb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb/luns/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] failed to remove resource iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb because of JDSS resource v_3096adae-4f81-4e5f-b41e-453c2656a2bb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] delete target: iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] delete target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] failed to remove resource iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb because of JDSS resource iqn.2010-10.org.openstack:3096adae-4f81-4e5f-b41e-453c2656a2bb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] deleating volume v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] get snapshots for volume v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 04:25:31', 'volsize': '1073741824', 'createtxg': '111299', 'guid': '850477665843677605', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'objsetid': '82614', 'name': 'v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'defer_destroy': 'off', 'san:volume_id': 'ccee458f62f6ce39f5040ba474c2a31c33099e0c', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9541f10-18f5-4733-bb1c-67b444f4feab {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] volume v_f9541f10-18f5-4733-bb1c-67b444f4feab deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.quota [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Created reservations ['6cbf008f-2529-4610-9637-badef2afe52b', '318fd4e4-f3db-418e-881d-ee26f9f16f6e', 'bef12adf-2b81-4c9f-b03f-3ae164ef56f2', '81418a1e-3a76-4ddb-849f-3997761f619b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303832064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.manager [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:02:06 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Deleted volume successfully. Apr 14 02:02:06 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a765c152-fbae-488a-b1ef-bc19733558b6 tempest-VolumesSnapshotListTestJSON-1041625499 None] Lock "cinder-f9541f10-18f5-4733-bb1c-67b444f4feab-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] volume v_3096adae-4f81-4e5f-b41e-453c2656a2bb updated {{(pid=73579) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=26,cinder:INSERT=14,cinder:SELECT=59,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.quota [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Created reservations ['c09fbff2-f52d-44c4-8906-fdbd45d51078', '81a207ab-11c1-4b5b-b7b9-9d8db1ba0d0f', '5cbbfe4f-42a9-4d97-bc73-2b1c2ad2a7e2', 'd05bafa0-db50-4709-9480-3906dd7b5f72'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=52,cinder:INSERT=14,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303832064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.manager [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:02:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Deleted volume successfully. Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb9d1694-08a1-4d2e-9462-04249bd243c8 tempest-VolumeAndVolumeTypeFromImageTest-1939859538 None] Lock "cinder-3096adae-4f81-4e5f-b41e-453c2656a2bb-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Acquiring lock "cinder-5142b1a2-8395-4b00-90ee-33ee973eb5b9-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:02:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Lock "cinder-5142b1a2-8395-4b00-90ee-33ee973eb5b9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] remove_export for volume: 5142b1a2-8395-4b00-90ee-33ee973eb5b9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='True'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='image-2743d171-521e-4858-8bd6-121947994874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5142b1a2-8395-4b00-90ee-33ee973eb5b9,launched_at=2023-04-14T02:02:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d20380b49e4ac2a78e44d2973ed7ce',provider_auth='CHAP EHbysoQx EY5dJjVqw6Mcz0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3096adae-4f81-4e5f-b41e-453c2656a2bb,status='deleting',terminated_at=2023-04-14T02:02:08Z,updated_at=2023-04-14T02:02:08Z,use_quota=True,user_id='11a703fbca99487897966a7ccadb533e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fddb1c85-4879-43ef-8613-ce5b910fbcdb),volume_type_id=fddb1c85-4879-43ef-8613-ce5b910fbcdb) from target:iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] detach volume v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 from target iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9/luns/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9/luns/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9/luns/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9/luns/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] failed to remove resource iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 because of JDSS resource v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] delete target: iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] delete target iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] failed to remove resource iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 because of JDSS resource iqn.2010-10.org.openstack:5142b1a2-8395-4b00-90ee-33ee973eb5b9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] deleating volume v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] get snapshots for volume v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] get volume v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_3096adae-4f81-4e5f-b41e-453c2656a2bb@v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439132', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '111303', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14463042585542114598', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3b74ce353e0a475c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303832064', 'san:volume_id': '3b74ce353e0a475c415b40068f8b3bdd1c37e375', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '82907', 'name': 'v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '8192', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] get snapshots for volume t_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 04:25:31', 'volsize': '1073741824', 'createtxg': '111299', 'guid': '850477665843677605', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'objsetid': '82614', 'name': 'v_5142b1a2-8395-4b00-90ee-33ee973eb5b9', 'defer_destroy': 'off', 'san:volume_id': 'ccee458f62f6ce39f5040ba474c2a31c33099e0c', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] get volume t_3096adae-4f81-4e5f-b41e-453c2656a2bb info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_3096adae-4f81-4e5f-b41e-453c2656a2bb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439115', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '111259', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15510421992319222099', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '159744', 'compressratio': '4.87', 'rootcontext': 'none', 'default_scsi_id': 'ccee458f62f6ce39', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303832064', 'san:volume_id': 'ccee458f62f6ce39f5040ba474c2a31c33099e0c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '61440', 'objsetid': '83094', 'name': 't_3096adae-4f81-4e5f-b41e-453c2656a2bb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '61440', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] delete volume:t_3096adae-4f81-4e5f-b41e-453c2656a2bb recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3096adae-4f81-4e5f-b41e-453c2656a2bb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Lock "cinder-5142b1a2-8395-4b00-90ee-33ee973eb5b9-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server [None req-28420f61-342c-46b0-8ce0-c401cbed8861 tempest-VolumeAndVolumeTypeFromImageTest-483966216 None] Exception during message handling: KeyError: 'errno' Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 02:02:09 user cinder-volume[73579]: ERROR oslo_messaging.rpc.server Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Flow 'volume_create_manager' (a31a39bb-76f4-4ab1-b95f-01cf6df2df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44cafec-7e41-44f9-a582-75a2a940878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44cafec-7e41-44f9-a582-75a2a940878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-952640453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d6e664bf-00ef-4bb1-835c-e96535d4bb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27dc405e16434633956ed2cd7e1791cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:02:24Z,use_quota=True,user_id='7ae5170969344b9fa5294231f8ffbe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65170456-ce74-413c-aa72-68451ff6cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65170456-ce74-413c-aa72-68451ff6cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96ab91c-26c1-4e52-8dfa-e36130e337d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96ab91c-26c1-4e52-8dfa-e36130e337d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e664bf-00ef-4bb1-835c-e96535d4bb32', 'volume_name': 'volume-d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c07089-0712-4673-882a-c32f4cf89a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c07089-0712-4673-882a-c32f4cf89a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd94bee-bca0-40ac-a1df-44d3e686a474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Volume d6e664bf-00ef-4bb1-835c-e96535d4bb32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'volume_size': 1} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] creating volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] create volume {'name': 'v_d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'is_clone': False, 'name': 'v_d6e664bf-00ef-4bb1-835c-e96535d4bb32'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd94bee-bca0-40ac-a1df-44d3e686a474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ffc857-1102-424b-bc45-e5c673dacdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Volume volume-d6e664bf-00ef-4bb1-835c-e96535d4bb32 (d6e664bf-00ef-4bb1-835c-e96535d4bb32): created successfully Apr 14 02:02:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ffc857-1102-424b-bc45-e5c673dacdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Flow 'volume_create_manager' (a31a39bb-76f4-4ab1-b95f-01cf6df2df50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3c144946-f270-492b-b1e5-5a6d2aacd958 tempest-TestStampPattern-190654074 None] Created volume successfully. Apr 14 02:02:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:02:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:02:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:02:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293575680', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:02:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:02:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Flow 'volume_create_manager' (bba7da11-615c-49f4-8e80-929b9bb9fdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49c6ba-77b1-47ea-b145-a6176b98d679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49c6ba-77b1-47ea-b145-a6176b98d679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-842000716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=97ad20ea-9d0f-482a-944e-c43cdf18b5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:02:47Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab983efe-072d-4c8d-9fbf-722b6218a315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab983efe-072d-4c8d-9fbf-722b6218a315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf192beb-d469-4d68-8a42-91b1801b0513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf192beb-d469-4d68-8a42-91b1801b0513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'volume_name': 'volume-97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafeaa5f-6e11-41c2-b147-ddbceafe886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafeaa5f-6e11-41c2-b147-ddbceafe886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7553f15-d6cc-4fcf-879d-a2642b142da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:47 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Volume 97ad20ea-9d0f-482a-944e-c43cdf18b5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'volume_size': 1} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] creating volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] create volume {'name': 'v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'is_clone': False, 'name': 'v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7553f15-d6cc-4fcf-879d-a2642b142da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c368261-3e52-4c02-bd6d-6df8e0dc8b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:47 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Volume volume-97ad20ea-9d0f-482a-944e-c43cdf18b5aa (97ad20ea-9d0f-482a-944e-c43cdf18b5aa): created successfully Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c368261-3e52-4c02-bd6d-6df8e0dc8b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Flow 'volume_create_manager' (bba7da11-615c-49f4-8e80-929b9bb9fdce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:47 user cinder-volume[73579]: INFO cinder.volume.manager [None req-fd70ca5d-cc4d-4863-a29c-729a66c2806d tempest-AttachVolumeTestJSON-296004410 None] Created volume successfully. Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] create export for volume: 97ad20ea-9d0f-482a-944e-c43cdf18b5aa. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] ensure volume 97ad20ea-9d0f-482a-944e-c43cdf18b5aa assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] check if targe iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] create target and attach volume 97ad20ea-9d0f-482a-944e-c43cdf18b5aa to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] create target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] atach volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa to target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:02:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6263356330363038', 'lun': 0, 'mode': 'wt', 'name': 'v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'prod_id': 'Storage', 'scsi_id': 'bc5c06080316dfc9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] add credentails to target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:02:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'name': 'hlmbKWiI'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] initialize_connection for 97ad20ea-9d0f-482a-944e-c43cdf18b5aa 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:02:53 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlmbKWiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '2aedc539-d08e-4ecc-b897-3c995a8c3a04'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:02:54 user cinder-volume[73579]: INFO cinder.volume.manager [req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 req-b7cdb21d-12e9-4b38-9f67-c2903bdf5046 tempest-AttachVolumeTestJSON-296004410 None] attachment_update completed successfully. Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Acquiring lock "cinder-58e2cd82-9771-4c59-8fe0-b03034cbe005-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Lock "cinder-58e2cd82-9771-4c59-8fe0-b03034cbe005-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] remove_export for volume: 58e2cd82-9771-4c59-8fe0-b03034cbe005. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-762453306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=58e2cd82-9771-4c59-8fe0-b03034cbe005,launched_at=2023-04-14T01:58:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d05ca328d64f2aa1d19550475edba3',provider_auth='CHAP WEpzmkQH WibdyB5Pa28wuV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:58:20Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:02:57Z,updated_at=2023-04-14T02:02:57Z,use_quota=True,user_id='2a5da3e233c74524a953ce0d4e074077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] detach volume v_58e2cd82-9771-4c59-8fe0-b03034cbe005 from target iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005/luns/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005/luns/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005/luns/v_58e2cd82-9771-4c59-8fe0-b03034cbe005'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005/luns/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] failed to remove resource iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 because of JDSS resource v_58e2cd82-9771-4c59-8fe0-b03034cbe005 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete target: iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete target iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] failed to remove resource iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 because of JDSS resource iqn.2010-10.org.openstack:58e2cd82-9771-4c59-8fe0-b03034cbe005 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] deleating volume v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] get snapshots for volume v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Flow 'volume_create_manager' (4355a195-804c-4fa3-8a54-f11549b5620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682c064b-590f-4647-a756-127b026cbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682c064b-590f-4647-a756-127b026cbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2142718081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=41242a52-99d3-435b-aef0-48d05e966fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:02:58Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3555f4-533c-46a4-93e2-1f4c0dd7738c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3555f4-533c-46a4-93e2-1f4c0dd7738c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1424ddc-6985-4038-8738-3ff793f90b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1424ddc-6985-4038-8738-3ff793f90b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41242a52-99d3-435b-aef0-48d05e966fc0', 'volume_name': 'volume-41242a52-99d3-435b-aef0-48d05e966fc0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b85433-c8b1-4469-85da-11afe4ab6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b85433-c8b1-4469-85da-11afe4ab6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051af4fa-a8fd-4787-9af8-4cc5bd64ebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:57 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Volume 41242a52-99d3-435b-aef0-48d05e966fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41242a52-99d3-435b-aef0-48d05e966fc0', 'volume_size': 1} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] creating volume v_41242a52-99d3-435b-aef0-48d05e966fc0. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] create volume {'name': 'v_41242a52-99d3-435b-aef0-48d05e966fc0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] get volume v_58e2cd82-9771-4c59-8fe0-b03034cbe005 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_58e2cd82-9771-4c59-8fe0-b03034cbe005', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438910', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111171', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16222067502783073840', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '52cf2bfd58540e8e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293493760', 'san:volume_id': '52cf2bfd58540e8e575ebbffe284f3938ca8dd7c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83393', 'name': 'v_58e2cd82-9771-4c59-8fe0-b03034cbe005', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete volume:v_58e2cd82-9771-4c59-8fe0-b03034cbe005 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:02:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_41242a52-99d3-435b-aef0-48d05e966fc0', 'is_clone': False, 'name': 'v_41242a52-99d3-435b-aef0-48d05e966fc0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051af4fa-a8fd-4787-9af8-4cc5bd64ebfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41242a52-99d3-435b-aef0-48d05e966fc0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba04c46-da06-41a2-bef3-3519493291e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:02:58 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Volume volume-41242a52-99d3-435b-aef0-48d05e966fc0 (41242a52-99d3-435b-aef0-48d05e966fc0): created successfully Apr 14 02:02:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba04c46-da06-41a2-bef3-3519493291e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:02:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Flow 'volume_create_manager' (4355a195-804c-4fa3-8a54-f11549b5620c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:02:58 user cinder-volume[73579]: INFO cinder.volume.manager [None req-265cdfe2-3e18-49f2-9cc5-f9ab3231e786 tempest-AttachVolumeTestJSON-296004410 None] Created volume successfully. Apr 14 02:02:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_58e2cd82-9771-4c59-8fe0-b03034cbe005 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:02:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] volume v_58e2cd82-9771-4c59-8fe0-b03034cbe005 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:02:59 user cinder-volume[73579]: DEBUG cinder.quota [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Created reservations ['0dc1bccb-f036-420a-a11b-17b02290668f', 'a44956cf-c6e3-4a95-9d1d-31017ad731db', '58746d51-8388-4e35-b3d4-5feec81cd5f6', 'a76df0b4-e5b4-4d41-ad72-7a781abf8cdb'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:02:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:02:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:02:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:02:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293493760', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.manager [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:00 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Deleted volume successfully. Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d8cc764c-bfe8-448a-af99-9e876a2b4b36 tempest-AttachVolumeShelveTestJSON-2042065984 None] Lock "cinder-58e2cd82-9771-4c59-8fe0-b03034cbe005-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] create export for volume: 41242a52-99d3-435b-aef0-48d05e966fc0. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] ensure volume 41242a52-99d3-435b-aef0-48d05e966fc0 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] check if targe iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] create target and attach volume 41242a52-99d3-435b-aef0-48d05e966fc0 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] create target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Acquiring lock "cinder-26c6e12f-4381-4acd-a6e5-a979a6886f25-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Lock "cinder-26c6e12f-4381-4acd-a6e5-a979a6886f25-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] remove_export for volume: 26c6e12f-4381-4acd-a6e5-a979a6886f25. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-846878611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=26c6e12f-4381-4acd-a6e5-a979a6886f25,launched_at=2023-04-14T01:51:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d05ca328d64f2aa1d19550475edba3',provider_auth='CHAP zameKywh N0T3sLwyQ4IuWO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:51:01Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:03:00Z,updated_at=2023-04-14T02:03:00Z,use_quota=True,user_id='2a5da3e233c74524a953ce0d4e074077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] detach volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25 from target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns/v_26c6e12f-4381-4acd-a6e5-a979a6886f25'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25/luns/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] failed to remove resource iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 because of JDSS resource v_26c6e12f-4381-4acd-a6e5-a979a6886f25 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] failed to remove resource iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 because of JDSS resource iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] deleating volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] get snapshots for volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] get volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_26c6e12f-4381-4acd-a6e5-a979a6886f25', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438470', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110959', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7848433014555288896', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1f989664039e7606', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293493760', 'san:volume_id': '1f989664039e760601e2f4e8000faced3a4c814b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82534', 'name': 'v_26c6e12f-4381-4acd-a6e5-a979a6886f25', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] delete volume:v_26c6e12f-4381-4acd-a6e5-a979a6886f25 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_26c6e12f-4381-4acd-a6e5-a979a6886f25 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] volume v_26c6e12f-4381-4acd-a6e5-a979a6886f25 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:03:02 user cinder-volume[73579]: DEBUG cinder.quota [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Created reservations ['25f83d8e-0c9f-4328-9128-359ccb8e79e8', 'b445ebb0-d3bf-47e7-adf2-e45ee86e6123', 'f348a27d-a30f-4be6-ac7b-3fc1b3fa9606', '78b0424e-91ba-4c37-84d3-563dd5117987'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] atach volume v_41242a52-99d3-435b-aef0-48d05e966fc0 to target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293575680', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.manager [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Deleted volume successfully. Apr 14 02:03:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c5e8df83-bc06-40a8-a979-e4f61af1cb72 tempest-AttachVolumeShelveTestJSON-2042065984 None] Lock "cinder-26c6e12f-4381-4acd-a6e5-a979a6886f25-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3366313266373261', 'lun': 0, 'mode': 'wt', 'name': 'v_41242a52-99d3-435b-aef0-48d05e966fc0', 'prod_id': 'Storage', 'scsi_id': '3f12f72a5dece280'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] add credentails to target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:03:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YyfdkZNQ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] initialize_connection for 41242a52-99d3-435b-aef0-48d05e966fc0 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:03:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfdkZNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '520c6b3f-c68d-4ee4-adea-f0b619e84d62'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:03:04 user cinder-volume[73579]: INFO cinder.volume.manager [req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 req-2cf3e880-cdc2-473d-b4a4-db5becc89696 tempest-AttachVolumeTestJSON-296004410 None] attachment_update completed successfully. Apr 14 02:03:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=61,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (db2cf30e-bec8-477d-94c5-3b9fa27c74bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeed7e9-646a-43fb-ab02-579c7c78f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeed7e9-646a-43fb-ab02-579c7c78f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1711983709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:09Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c77a00-4b89-4e61-b9de-68051ed873c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c77a00-4b89-4e61-b9de-68051ed873c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba527c39-b207-4b3f-92c4-75a64192b990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba527c39-b207-4b3f-92c4-75a64192b990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'volume_name': 'volume-5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5396df4-7283-43a4-af6a-1bebfdb3319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5396df4-7283-43a4-af6a-1bebfdb3319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ebb696-a55c-458f-803e-38b8788846b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:08 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'volume_size': 1} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] creating volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume {'name': 'v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] terminate connection for 97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:03:08 user cinder-volume[73579]: INFO cinder.volume.manager [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Terminate volume connection completed successfully. Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Deleting attachment 2aedc539-d08e-4ecc-b897-3c995a8c3a04. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] remove_export for volume: 97ad20ea-9d0f-482a-944e-c43cdf18b5aa. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-842000716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=97ad20ea-9d0f-482a-944e-c43cdf18b5aa,launched_at=2023-04-14T02:02:48Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth='CHAP hlmbKWiI ne8oY1mVO9XIWC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:47Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:03:08Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] detach volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa from target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'is_clone': False, 'name': 'v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ebb696-a55c-458f-803e-38b8788846b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957bd165-8938-46dc-a631-49a4d17934a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:09 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume volume-5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 (5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449): created successfully Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957bd165-8938-46dc-a631-49a4d17934a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (db2cf30e-bec8-477d-94c5-3b9fa27c74bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-48338a36-bf84-4a54-9855-e3c60f2a3075 tempest-VolumesSnapshotTestJSON-2121749885 None] Created volume successfully. Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b3377059-c878-4b5e-9779-0251eee85845 tempest-BackendsCapabilitiesAdminTestsJSON-1957534206 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73579) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-067c6293-7cc1-4188-b0c3-1a896a410944 tempest-BackendsCapabilitiesAdminTestsJSON-1957534206 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73579) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] delete target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] delete target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 req-c71767d0-aeb9-483c-a109-00875102e1ac tempest-AttachVolumeTestJSON-296004410 None] target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (db27de5b-c793-467f-b13c-8f49c2914a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b3d15c-6bc4-4295-9cf9-cf48e1df0215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b3d15c-6bc4-4295-9cf9-cf48e1df0215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145429467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e30d5da-2923-47a9-9cb1-98605d191299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:10Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d53baed-6072-4df0-924a-e2ceaaa7e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d53baed-6072-4df0-924a-e2ceaaa7e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b701e5-2d8e-4521-a5ca-993fc91b6c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b701e5-2d8e-4521-a5ca-993fc91b6c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e30d5da-2923-47a9-9cb1-98605d191299', 'volume_name': 'volume-8e30d5da-2923-47a9-9cb1-98605d191299', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81386f4-80fd-4c85-9814-ee6c5ac91b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81386f4-80fd-4c85-9814-ee6c5ac91b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dd44e0-68d7-45d8-8022-57293a60d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:10 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume 8e30d5da-2923-47a9-9cb1-98605d191299: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e30d5da-2923-47a9-9cb1-98605d191299', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Cloning 8e30d5da-2923-47a9-9cb1-98605d191299 from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 2, 3, 10, 410749)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 2, 3, 10, 424319)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to 8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_8e30d5da-2923-47a9-9cb1-98605d191299'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume v_8e30d5da-2923-47a9-9cb1-98605d191299 from snapshot v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:03:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] terminate connection for 41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:03:12 user cinder-volume[73579]: INFO cinder.volume.manager [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Terminate volume connection completed successfully. Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Deleting attachment 520c6b3f-c68d-4ee4-adea-f0b619e84d62. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] remove_export for volume: 41242a52-99d3-435b-aef0-48d05e966fc0. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2142718081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=41242a52-99d3-435b-aef0-48d05e966fc0,launched_at=2023-04-14T02:02:59Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth='CHAP YyfdkZNQ Wh8qTFM6GbC75i',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:58Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:03:12Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] detach volume v_41242a52-99d3-435b-aef0-48d05e966fc0 from target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_8e30d5da-2923-47a9-9cb1-98605d191299', 'is_clone': True, 'full_name': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299', 'name': 'v_8e30d5da-2923-47a9-9cb1-98605d191299'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_8e30d5da-2923-47a9-9cb1-98605d191299 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] delete target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] delete target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_8e30d5da-2923-47a9-9cb1-98605d191299', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439201', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111346', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1222166920597254311', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '63441e22069ecf8c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293469184', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83721', 'name': 'v_8e30d5da-2923-47a9-9cb1-98605d191299', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Marking volume 8e30d5da-2923-47a9-9cb1-98605d191299 as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to 8e30d5da-2923-47a9-9cb1-98605d191299. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Creating volume glance metadata for volume 8e30d5da-2923-47a9-9cb1-98605d191299 backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=27,cinder:SELECT=72,cinder:INSERT=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dd44e0-68d7-45d8-8022-57293a60d921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e30d5da-2923-47a9-9cb1-98605d191299', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddbda6c-3f16-4f06-9120-506d72207ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:13 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume volume-8e30d5da-2923-47a9-9cb1-98605d191299 (8e30d5da-2923-47a9-9cb1-98605d191299): created successfully Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddbda6c-3f16-4f06-9120-506d72207ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (db27de5b-c793-467f-b13c-8f49c2914a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:13 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a8420468-c39e-47ee-96a5-9bff8bfe3941 tempest-VolumesSnapshotTestJSON-2121749885 None] Created volume successfully. Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9835208f-6917-4b67-b940-723b5c62d9fe req-b88086c3-9862-4e6f-93e6-c990c25d6350 tempest-AttachVolumeTestJSON-296004410 None] target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (a6a4febb-cac6-4e53-a609-113aed08705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c30976f-1f7a-4b3e-8fdd-133537844d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c30976f-1f7a-4b3e-8fdd-133537844d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1723199575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=73ffe4cc-fd18-4441-a7c8-b9f7c2019d89,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:16Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17480e61-e5aa-4e29-9371-6df893173f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17480e61-e5aa-4e29-9371-6df893173f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac021d64-2145-49b1-9f64-dc9e34071dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac021d64-2145-49b1-9f64-dc9e34071dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'volume_name': 'volume-73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb21f17-c2af-4cc8-a4ee-5fa517ea7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb21f17-c2af-4cc8-a4ee-5fa517ea7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31fff63-7e6c-4924-b8a5-6211ad6957d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:16 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Volume 73ffe4cc-fd18-4441-a7c8-b9f7c2019d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'volume_size': 1} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] creating volume v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] create volume {'name': 'v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'is_clone': False, 'name': 'v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31fff63-7e6c-4924-b8a5-6211ad6957d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3f4b5e-7939-46e9-bd49-e01af305b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:17 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Volume volume-73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 (73ffe4cc-fd18-4441-a7c8-b9f7c2019d89): created successfully Apr 14 02:03:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3f4b5e-7939-46e9-bd49-e01af305b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:17 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (a6a4febb-cac6-4e53-a609-113aed08705c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:17 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1876f339-0ed0-41e7-8232-23f328bc5859 tempest-VolumesGetTest-1669783756 None] Created volume successfully. Apr 14 02:03:18 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (aa4f5164-aa76-4a54-9e16-741ec7c22e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36329b9-8e99-4033-be78-b86d761a8525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36329b9-8e99-4033-be78-b86d761a8525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1570572327',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9c5094a-8085-492c-8a9f-423e5d331158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:19Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0ab9dc-5e9e-4802-ac45-9324f40b1f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0ab9dc-5e9e-4802-ac45-9324f40b1f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4253ae8-a32e-4189-a575-b832fffe3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4253ae8-a32e-4189-a575-b832fffe3c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c5094a-8085-492c-8a9f-423e5d331158', 'volume_name': 'volume-b9c5094a-8085-492c-8a9f-423e5d331158', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332437a4-576f-44d7-b6aa-1b2951122966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332437a4-576f-44d7-b6aa-1b2951122966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c0a49e-f48e-4bd9-858b-9f63ed2a9c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:19 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Volume b9c5094a-8085-492c-8a9f-423e5d331158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c5094a-8085-492c-8a9f-423e5d331158', 'volume_size': 1} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] creating volume v_b9c5094a-8085-492c-8a9f-423e5d331158. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] create volume {'name': 'v_b9c5094a-8085-492c-8a9f-423e5d331158', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b9c5094a-8085-492c-8a9f-423e5d331158', 'is_clone': False, 'name': 'v_b9c5094a-8085-492c-8a9f-423e5d331158'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c0a49e-f48e-4bd9-858b-9f63ed2a9c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c5094a-8085-492c-8a9f-423e5d331158', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2153ad4e-04b2-469e-a6a2-5b60291e872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:20 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Volume volume-b9c5094a-8085-492c-8a9f-423e5d331158 (b9c5094a-8085-492c-8a9f-423e5d331158): created successfully Apr 14 02:03:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2153ad4e-04b2-469e-a6a2-5b60291e872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (aa4f5164-aa76-4a54-9e16-741ec7c22e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f3324f66-6ece-46ec-8cdf-ad5112ee782a tempest-VolumesGetTest-1669783756 None] Created volume successfully. Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-b9c5094a-8085-492c-8a9f-423e5d331158-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Lock "cinder-b9c5094a-8085-492c-8a9f-423e5d331158-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] remove_export for volume: b9c5094a-8085-492c-8a9f-423e5d331158. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1723199575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9c5094a-8085-492c-8a9f-423e5d331158,launched_at=2023-04-14T02:03:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth='CHAP vQdxbLEY E4c5xn3vYOwDFZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:19Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:03:21Z,updated_at=2023-04-14T02:03:21Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] detach volume v_b9c5094a-8085-492c-8a9f-423e5d331158 from target iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158/luns/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158/luns/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158/luns/v_b9c5094a-8085-492c-8a9f-423e5d331158'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158/luns/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 because of JDSS resource v_b9c5094a-8085-492c-8a9f-423e5d331158 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] delete target: iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] delete target iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 because of JDSS resource iqn.2010-10.org.openstack:b9c5094a-8085-492c-8a9f-423e5d331158 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] deleating volume v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] get snapshots for volume v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] get volume v_b9c5094a-8085-492c-8a9f-423e5d331158 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9c5094a-8085-492c-8a9f-423e5d331158', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439208', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111354', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15364174201453880154', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd6667592f083b273', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293305344', 'san:volume_id': 'd6667592f083b273638c50556d14e33ace1cbfbd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83741', 'name': 'v_b9c5094a-8085-492c-8a9f-423e5d331158', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] delete volume:v_b9c5094a-8085-492c-8a9f-423e5d331158 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9c5094a-8085-492c-8a9f-423e5d331158 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] volume v_b9c5094a-8085-492c-8a9f-423e5d331158 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:03:23 user cinder-volume[73579]: DEBUG cinder.quota [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Created reservations ['7d2f83c6-9167-4543-a08e-5bac50cb8e1f', '3626f339-6668-4b07-8905-b7257e82e226', '7c4fa446-a5c9-4fa1-a8e8-6e74cc623bd0', 'cd491d1d-d4c2-4761-b4f7-e76c21a47176'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293387264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.manager [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Deleted volume successfully. Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a39e6d55-c6d1-43e7-ac85-3d182573c2b0 tempest-VolumesGetTest-1669783756 None] Lock "cinder-b9c5094a-8085-492c-8a9f-423e5d331158-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-73ffe4cc-fd18-4441-a7c8-b9f7c2019d89-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Lock "cinder-73ffe4cc-fd18-4441-a7c8-b9f7c2019d89-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] remove_export for volume: 73ffe4cc-fd18-4441-a7c8-b9f7c2019d89. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:16Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-272824508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=73ffe4cc-fd18-4441-a7c8-b9f7c2019d89,launched_at=2023-04-14T02:03:17Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth='CHAP YqHRcWFI gt6HyAmdeUfvQj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:16Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:03:24Z,updated_at=2023-04-14T02:03:24Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] detach volume v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 from target iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89/luns/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89/luns/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89/luns/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89/luns/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 because of JDSS resource v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] delete target: iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] delete target iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 because of JDSS resource iqn.2010-10.org.openstack:73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] deleating volume v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] get snapshots for volume v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] get volume v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439206', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111350', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2936415713870112301', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '657751ecf7df23e6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293387264', 'san:volume_id': '657751ecf7df23e6be360e6c37f8a2c42f9e6a33', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83732', 'name': 'v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] delete volume:v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] volume v_73ffe4cc-fd18-4441-a7c8-b9f7c2019d89 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=60,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=13 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG cinder.quota [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Created reservations ['bb836228-d398-4024-afe6-07bf5ec39cd9', 'fd8752ab-fe93-4d99-8cd8-824c5cb9bfdd', '630198f0-91a3-4821-aea6-617cef33bb10', 'a07fd55a-23a3-4244-8092-bcf34bbed265'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293469184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.manager [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Deleted volume successfully. Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ffdae205-7423-4488-941c-27f403637604 tempest-VolumesGetTest-1669783756 None] Lock "cinder-73ffe4cc-fd18-4441-a7c8-b9f7c2019d89-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (707c9f5d-2740-4865-8efd-70c6e855eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d0d862-1be3-4a7a-877b-e40383299215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d0d862-1be3-4a7a-877b-e40383299215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-526827086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49c5f6a4-350c-4602-a3f7-c5ce3228ed5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:28Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03efd700-8184-4d24-bba5-22a653a9aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03efd700-8184-4d24-bba5-22a653a9aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edff4874-248a-4299-ac0c-f502a72e6e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edff4874-248a-4299-ac0c-f502a72e6e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'volume_name': 'volume-49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3a537e-e5a3-479a-bc5c-092cc0346f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3a537e-e5a3-479a-bc5c-092cc0346f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f466885-3bf6-4e86-a440-a38aa5e93fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:27 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Volume 49c5f6a4-350c-4602-a3f7-c5ce3228ed5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'volume_size': 1} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] creating volume v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] create volume {'name': 'v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'is_clone': False, 'name': 'v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f466885-3bf6-4e86-a440-a38aa5e93fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0b63a5-5c1a-427f-a10f-94fb538d939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:28 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Volume volume-49c5f6a4-350c-4602-a3f7-c5ce3228ed5e (49c5f6a4-350c-4602-a3f7-c5ce3228ed5e): created successfully Apr 14 02:03:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0b63a5-5c1a-427f-a10f-94fb538d939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (707c9f5d-2740-4865-8efd-70c6e855eec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6723106e-ee3c-4b95-8123-edd691c4f36b tempest-VolumesGetTest-1669783756 None] Created volume successfully. Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (78d4ea64-5ab3-47af-8d9f-b3ac00b65742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62aa3d3-b8cf-4e9a-afe4-b2b5fe2dfa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62aa3d3-b8cf-4e9a-afe4-b2b5fe2dfa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-960179713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=03e3f47e-4075-428f-90ec-fc8d92fabc5c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=49c5f6a4-350c-4602-a3f7-c5ce3228ed5e,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:29Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f35e56-7f46-4933-8fd4-66bb42d02be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f35e56-7f46-4933-8fd4-66bb42d02be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd858ea-a8f4-41a1-9afb-d10c84492965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd858ea-a8f4-41a1-9afb-d10c84492965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'volume_name': 'volume-03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'volume_size': 1, 'source_volid': '49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'source_volstatus': 'available'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4526381d-cf3f-45ae-8b61-d3fb3566ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4526381d-cf3f-45ae-8b61-d3fb3566ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c3351-3083-478a-a833-b71ec6742ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Volume 03e3f47e-4075-428f-90ec-fc8d92fabc5c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'volume_size': 1, 'source_volid': '49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'source_volstatus': 'available'} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] cloned volume 49c5f6a4-350c-4602-a3f7-c5ce3228ed5e to 03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] cloning v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e to v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] create snapshot v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_03e3f47e-4075-428f-90ec-fc8d92fabc5c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] create volume v_03e3f47e-4075-428f-90ec-fc8d92fabc5c from snapshot v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e@v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'is_clone': True, 'full_name': 'Pool-0/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'name': 'v_03e3f47e-4075-428f-90ec-fc8d92fabc5c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] get volume v_03e3f47e-4075-428f-90ec-fc8d92fabc5c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e@v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439219', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111366', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5544579677821600583', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8550d88aa96b958a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293362688', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82810', 'name': 'v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c3351-3083-478a-a833-b71ec6742ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'volume_size': 1, 'source_volid': '49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'source_volstatus': 'available'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b957a67-3858-4c24-9f59-4e88b5de48a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:31 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Volume volume-03e3f47e-4075-428f-90ec-fc8d92fabc5c (03e3f47e-4075-428f-90ec-fc8d92fabc5c): created successfully Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b957a67-3858-4c24-9f59-4e88b5de48a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (78d4ea64-5ab3-47af-8d9f-b3ac00b65742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ce009df7-21b4-47e0-a1c3-123fc43b1a2c tempest-VolumesGetTest-1669783756 None] Created volume successfully. Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293362688', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (ed965f27-51f2-4920-9be3-b6c3a53f587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5f2452-1b3d-41cb-b525-f9c5fdd24837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5f2452-1b3d-41cb-b525-f9c5fdd24837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1342278127',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e7eccc2b-cd58-4880-9475-add6d5d044a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:33Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a84af5-ebd9-475d-8770-debafa2a25a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a84af5-ebd9-475d-8770-debafa2a25a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c1cab9-d7b9-4e8b-a92e-5956a55d7578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c1cab9-d7b9-4e8b-a92e-5956a55d7578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7eccc2b-cd58-4880-9475-add6d5d044a4', 'volume_name': 'volume-e7eccc2b-cd58-4880-9475-add6d5d044a4', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfb6e0e-e793-4e0f-9574-c35e3510c0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfb6e0e-e793-4e0f-9574-c35e3510c0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc2fe97-aeb8-4199-b964-1f3d0d8709e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:33 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Volume e7eccc2b-cd58-4880-9475-add6d5d044a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7eccc2b-cd58-4880-9475-add6d5d044a4', 'volume_size': 1} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] creating volume v_e7eccc2b-cd58-4880-9475-add6d5d044a4. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] create volume {'name': 'v_e7eccc2b-cd58-4880-9475-add6d5d044a4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e7eccc2b-cd58-4880-9475-add6d5d044a4', 'is_clone': False, 'name': 'v_e7eccc2b-cd58-4880-9475-add6d5d044a4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc2fe97-aeb8-4199-b964-1f3d0d8709e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7eccc2b-cd58-4880-9475-add6d5d044a4', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7f4891-9bcc-4d63-bbbe-84779a7bec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:34 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Volume volume-e7eccc2b-cd58-4880-9475-add6d5d044a4 (e7eccc2b-cd58-4880-9475-add6d5d044a4): created successfully Apr 14 02:03:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7f4891-9bcc-4d63-bbbe-84779a7bec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (ed965f27-51f2-4920-9be3-b6c3a53f587b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:34 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ec898b95-e9ac-48b1-a609-0c40fda63435 tempest-VolumesGetTest-1669783756 None] Created volume successfully. Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-e7eccc2b-cd58-4880-9475-add6d5d044a4-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Lock "cinder-e7eccc2b-cd58-4880-9475-add6d5d044a4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] remove_export for volume: e7eccc2b-cd58-4880-9475-add6d5d044a4. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-960179713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e7eccc2b-cd58-4880-9475-add6d5d044a4,launched_at=2023-04-14T02:03:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth='CHAP PchqeZXV rLokDjadU5Gie1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:33Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:03:36Z,updated_at=2023-04-14T02:03:36Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] detach volume v_e7eccc2b-cd58-4880-9475-add6d5d044a4 from target iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4/luns/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4/luns/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4/luns/v_e7eccc2b-cd58-4880-9475-add6d5d044a4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4/luns/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 because of JDSS resource v_e7eccc2b-cd58-4880-9475-add6d5d044a4 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] delete target: iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] delete target iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 because of JDSS resource iqn.2010-10.org.openstack:e7eccc2b-cd58-4880-9475-add6d5d044a4 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] deleating volume v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] get snapshots for volume v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] get volume v_e7eccc2b-cd58-4880-9475-add6d5d044a4 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=27,cinder:DELETE=4,cinder:SELECT=62,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e7eccc2b-cd58-4880-9475-add6d5d044a4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439223', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111370', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '489704381321799564', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f508c7c62551958c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293256192', 'san:volume_id': 'f508c7c62551958c76586ae2238237edf24b7874', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83846', 'name': 'v_e7eccc2b-cd58-4880-9475-add6d5d044a4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] delete volume:v_e7eccc2b-cd58-4880-9475-add6d5d044a4 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7eccc2b-cd58-4880-9475-add6d5d044a4 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] volume v_e7eccc2b-cd58-4880-9475-add6d5d044a4 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.quota [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Created reservations ['fa1256f4-3090-4859-99ba-121bd2e5add7', 'd39fd4dd-d43c-4973-9c74-b63b4d757b4f', '482fe662-d7a9-43df-a987-6500935868f3', '45429c79-c388-4c6f-a01c-a1186dae6c63'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293338112', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.manager [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:38 user cinder-volume[73579]: INFO cinder.volume.manager [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Deleted volume successfully. Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-435e51a3-425b-48a6-9f83-0adb1333e234 tempest-VolumesGetTest-1669783756 None] Lock "cinder-e7eccc2b-cd58-4880-9475-add6d5d044a4-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-03e3f47e-4075-428f-90ec-fc8d92fabc5c-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Lock "cinder-03e3f47e-4075-428f-90ec-fc8d92fabc5c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] remove_export for volume: 03e3f47e-4075-428f-90ec-fc8d92fabc5c. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:29Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-920587336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=03e3f47e-4075-428f-90ec-fc8d92fabc5c,launched_at=2023-04-14T02:03:31Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth='CHAP DPUhARYN 70Zk5IFpmn3G8H',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:29Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=49c5f6a4-350c-4602-a3f7-c5ce3228ed5e,status='deleting',terminated_at=2023-04-14T02:03:39Z,updated_at=2023-04-14T02:03:39Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] detach volume v_03e3f47e-4075-428f-90ec-fc8d92fabc5c from target iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c/luns/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c/luns/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c/luns/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c/luns/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c because of JDSS resource v_03e3f47e-4075-428f-90ec-fc8d92fabc5c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] delete target: iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] delete target iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c because of JDSS resource iqn.2010-10.org.openstack:03e3f47e-4075-428f-90ec-fc8d92fabc5c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] deleating volume v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] get snapshots for volume v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] get volume v_03e3f47e-4075-428f-90ec-fc8d92fabc5c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e@v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439219', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111366', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5544579677821600583', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8550d88aa96b958a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293338112', 'san:volume_id': '8550d88aa96b958a958754675610d1ee404d9249', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82810', 'name': 'v_03e3f47e-4075-428f-90ec-fc8d92fabc5c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] delete snapshot v_03e3f47e-4075-428f-90ec-fc8d92fabc5c of volume v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] terminate connection for 06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:03:39 user cinder-volume[73579]: INFO cinder.volume.manager [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Terminate volume connection completed successfully. Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Deleting attachment f932be5d-eab5-4d37-aaba-5e5df63df9f6. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: 06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1113854014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=06b73a5e-5178-4561-af91-11e1028d2238,launched_at=2023-04-14T02:01:43Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP HBVCXlJa 0BFXnkh3IfemQv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:40Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T02:01:53Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] detach volume v_06b73a5e-5178-4561-af91-11e1028d2238 from target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-c1e5f737-ce87-4e51-b57b-17370d1ef613 tempest-ServerActionsTestJSON-2035821517 None] target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots/v_03e3f47e-4075-428f-90ec-fc8d92fabc5c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] snapshot v_03e3f47e-4075-428f-90ec-fc8d92fabc5c deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:03:40 user cinder-volume[73579]: DEBUG cinder.quota [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Created reservations ['dcd353af-e674-40e5-a4aa-0336f3e4cd8b', '886c7f45-3190-4c29-b30a-7cd2bac40c4b', 'a27f1ea0-6524-4fd1-ba37-ffa209121a6d', 'f2212814-088b-4b1b-a967-882747d17cf9'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-49c5f6a4-350c-4602-a3f7-c5ce3228ed5e-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Lock "cinder-49c5f6a4-350c-4602-a3f7-c5ce3228ed5e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] remove_export for volume: 49c5f6a4-350c-4602-a3f7-c5ce3228ed5e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-526827086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49c5f6a4-350c-4602-a3f7-c5ce3228ed5e,launched_at=2023-04-14T02:03:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth='CHAP UyRBcsqd LI5cNnhtVCpOoM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:28Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:03:41Z,updated_at=2023-04-14T02:03:41Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] detach volume v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e from target iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/luns/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/luns/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/luns/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/luns/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e because of JDSS resource v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] delete target: iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] delete target iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e because of JDSS resource iqn.2010-10.org.openstack:49c5f6a4-350c-4602-a3f7-c5ce3228ed5e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] deleating volume v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] get snapshots for volume v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293362688', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.manager [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:41 user cinder-volume[73579]: INFO cinder.volume.manager [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Deleted volume successfully. Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-bb9dac2c-54e3-4cbe-86cd-f149a9b38cf7 tempest-VolumesGetTest-1669783756 None] Lock "cinder-03e3f47e-4075-428f-90ec-fc8d92fabc5c-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] get volume v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439217', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111360', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3540989777727120640', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9701d053fed45169', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293362688', 'san:volume_id': '9701d053fed4516912afb602adbe39b4bec24e1d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82797', 'name': 'v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] delete volume:v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] create export for volume: 06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] ensure volume 06b73a5e-5178-4561-af91-11e1028d2238 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] check if targe iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] create target and attach volume 06b73a5e-5178-4561-af91-11e1028d2238 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] create target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] volume v_49c5f6a4-350c-4602-a3f7-c5ce3228ed5e deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG cinder.quota [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Created reservations ['47d95e39-9aa5-4ab3-b52a-b589d931a663', '73f4206f-0ecd-4ddb-a37a-c3aab131af86', 'fe6627f3-5c48-4cf0-b019-409e6caf231e', '71e9f3c7-c8b8-4df4-9700-a489eaa59918'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=29,cinder:SELECT=56,cinder:DELETE=5,cinder:INSERT=10 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293444608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.manager [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Deleted volume successfully. Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2e0f8ac6-a7b5-4e8f-8e4b-4da8bf54d149 tempest-VolumesGetTest-1669783756 None] Lock "cinder-49c5f6a4-350c-4602-a3f7-c5ce3228ed5e-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] atach volume v_06b73a5e-5178-4561-af91-11e1028d2238 to target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (5a7f5b61-54c5-451f-9a2a-232330cb5782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec0a851-eaea-4fd7-a0a6-d5513713bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec0a851-eaea-4fd7-a0a6-d5513713bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-711629040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a92d07cb-ab21-4494-a512-8039f9adab4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:45Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed02b336-bf81-4904-9261-669c2ee2f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed02b336-bf81-4904-9261-669c2ee2f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae48d99-ae27-4cf1-bb9e-be90cafb8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae48d99-ae27-4cf1-bb9e-be90cafb8285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a92d07cb-ab21-4494-a512-8039f9adab4c', 'volume_name': 'volume-a92d07cb-ab21-4494-a512-8039f9adab4c', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcee1484-5261-4808-b583-c53fa28e1e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcee1484-5261-4808-b583-c53fa28e1e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b7d70-afa0-4b81-9038-27e7efaada2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:44 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Volume a92d07cb-ab21-4494-a512-8039f9adab4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a92d07cb-ab21-4494-a512-8039f9adab4c', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Cloning a92d07cb-ab21-4494-a512-8039f9adab4c from image b1bc26f9-63fb-4bff-8f72-f1e49544441d at location (None, None). {{(pid=73579) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" by "_prepare_image_cache_entry" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 2, 3, 44, 984581)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Found cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Lock "cinder-b1bc26f9-63fb-4bff-8f72-f1e49544441d" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:44 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Attempting to retrieve cache entry for image = b1bc26f9-63fb-4bff-8f72-f1e49544441d on host user@joviandss-2#joviandss-2. {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'volume_id': 'ccaaa5cb-e964-406f-baca-e7660e8ceff4', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56), 'last_used': datetime.datetime(2023, 4, 14, 2, 3, 44, 998354)}. {{(pid=73579) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.image.cache [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Image-volume cache entry image_update_at = 2023-04-14 01:36:56+00:00, requested image updated_at = 2023-04-14 01:36:56+00:00. {{(pid=73579) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Creating from source image-volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] cloned volume ccaaa5cb-e964-406f-baca-e7660e8ceff4 to a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] cloning v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 to v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] create snapshot v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3466306261366663', 'lun': 0, 'mode': 'wt', 'name': 'v_06b73a5e-5178-4561-af91-11e1028d2238', 'prod_id': 'Storage', 'scsi_id': '4f0ba6fcc48ee1f6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] add credentails to target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HBVCXlJa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] initialize_connection for 06b73a5e-5178-4561-af91-11e1028d2238 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:03:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '16d86764-c060-45f1-9c4a-8cc75f65ca31'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:03:46 user cinder-volume[73579]: INFO cinder.volume.manager [req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef req-299aed10-502e-4e32-a622-e0fa8433ad4f tempest-ServerActionsTestJSON-2035821517 None] attachment_update completed successfully. Apr 14 02:03:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_a92d07cb-ab21-4494-a512-8039f9adab4c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] create volume v_a92d07cb-ab21-4494-a512-8039f9adab4c from snapshot v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:03:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'is_clone': True, 'full_name': 'Pool-0/v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'name': 'v_a92d07cb-ab21-4494-a512-8039f9adab4c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] get volume v_a92d07cb-ab21-4494-a512-8039f9adab4c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439235', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111389', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14627657978583368859', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c7a726106cc9f5f0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293420032', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82219', 'name': 'v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.volume_utils [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Marking volume a92d07cb-ab21-4494-a512-8039f9adab4c as bootable. {{(pid=73579) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Copying metadata from image b1bc26f9-63fb-4bff-8f72-f1e49544441d to a92d07cb-ab21-4494-a512-8039f9adab4c. {{(pid=73579) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Creating volume glance metadata for volume a92d07cb-ab21-4494-a512-8039f9adab4c backed by image b1bc26f9-63fb-4bff-8f72-f1e49544441d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73579) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=63,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b7d70-afa0-4b81-9038-27e7efaada2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92d07cb-ab21-4494-a512-8039f9adab4c', 'volume_size': 1, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3663dea83d234eeca8dc09f5d706a616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'created_at': datetime.datetime(2023, 4, 14, 1, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 1, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1bc26f9-63fb-4bff-8f72-f1e49544441d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32af50b-31cd-4dee-b6da-b44f412ac69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:47 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Volume volume-a92d07cb-ab21-4494-a512-8039f9adab4c (a92d07cb-ab21-4494-a512-8039f9adab4c): created successfully Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32af50b-31cd-4dee-b6da-b44f412ac69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:47 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (5a7f5b61-54c5-451f-9a2a-232330cb5782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:47 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3dc7115f-8f1b-463d-9321-572267f2ddc4 tempest-VolumesGetTest-1669783756 None] Created volume successfully. Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (537e31d0-915a-45a2-9976-58df934d3ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d31c4bc-74ab-442a-93ea-515f4db028cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d31c4bc-74ab-442a-93ea-515f4db028cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1687056147',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c7c2d31b-01e0-4876-9690-3778a818596a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:03:49Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ede26e-0cd7-4c8f-b8f1-11691150eff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ede26e-0cd7-4c8f-b8f1-11691150eff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9ccf32-b7b8-4e40-9aaf-9407c7079760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9ccf32-b7b8-4e40-9aaf-9407c7079760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c2d31b-01e0-4876-9690-3778a818596a', 'volume_name': 'volume-c7c2d31b-01e0-4876-9690-3778a818596a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fecb0f-e6eb-4d46-a607-c9329317b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fecb0f-e6eb-4d46-a607-c9329317b007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe19c2c-abc3-4ea5-a081-9d942403a579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:48 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Volume c7c2d31b-01e0-4876-9690-3778a818596a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c2d31b-01e0-4876-9690-3778a818596a', 'volume_size': 1} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] creating volume v_c7c2d31b-01e0-4876-9690-3778a818596a. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] create volume {'name': 'v_c7c2d31b-01e0-4876-9690-3778a818596a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c7c2d31b-01e0-4876-9690-3778a818596a', 'is_clone': False, 'name': 'v_c7c2d31b-01e0-4876-9690-3778a818596a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe19c2c-abc3-4ea5-a081-9d942403a579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c2d31b-01e0-4876-9690-3778a818596a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf0900d-0c6f-4683-b51c-c73ace10ef77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:03:49 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Volume volume-c7c2d31b-01e0-4876-9690-3778a818596a (c7c2d31b-01e0-4876-9690-3778a818596a): created successfully Apr 14 02:03:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf0900d-0c6f-4683-b51c-c73ace10ef77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:03:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Flow 'volume_create_manager' (537e31d0-915a-45a2-9976-58df934d3ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:03:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8eb8b4a4-6c2e-4b18-baca-eb5dfb360e56 tempest-VolumesGetTest-1669783756 None] Created volume successfully. Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-c7c2d31b-01e0-4876-9690-3778a818596a-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Lock "cinder-c7c2d31b-01e0-4876-9690-3778a818596a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] remove_export for volume: c7c2d31b-01e0-4876-9690-3778a818596a. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-711629040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c7c2d31b-01e0-4876-9690-3778a818596a,launched_at=2023-04-14T02:03:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth='CHAP mqapEntW s0ZiwA5BCVTRJ7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:48Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:03:51Z,updated_at=2023-04-14T02:03:51Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] detach volume v_c7c2d31b-01e0-4876-9690-3778a818596a from target iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a/luns/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a/luns/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a/luns/v_c7c2d31b-01e0-4876-9690-3778a818596a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a/luns/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a because of JDSS resource v_c7c2d31b-01e0-4876-9690-3778a818596a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] delete target: iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] delete target iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a because of JDSS resource iqn.2010-10.org.openstack:c7c2d31b-01e0-4876-9690-3778a818596a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] deleating volume v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] get snapshots for volume v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] get volume v_c7c2d31b-01e0-4876-9690-3778a818596a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c7c2d31b-01e0-4876-9690-3778a818596a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439238', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111393', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9570985725443228113', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ded4b2209707791f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293301248', 'san:volume_id': 'ded4b2209707791f9a8df2064ef6913317269a97', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82229', 'name': 'v_c7c2d31b-01e0-4876-9690-3778a818596a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] delete volume:v_c7c2d31b-01e0-4876-9690-3778a818596a recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7c2d31b-01e0-4876-9690-3778a818596a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] volume v_c7c2d31b-01e0-4876-9690-3778a818596a deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.quota [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Created reservations ['467f4722-e8e7-49f9-96e7-93deb58fc9da', '32c67f98-2b3a-43db-b4cb-74edcc8d229a', 'b9ef7ffd-9219-4ae4-ae0c-1737e5126a27', '98930a99-74ac-4a54-9c8f-ba9914c85641'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293383168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.manager [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:53 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Deleted volume successfully. Apr 14 02:03:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4a5753f0-0374-4cb8-b0c3-798f49c9330c tempest-VolumesGetTest-1669783756 None] Lock "cinder-c7c2d31b-01e0-4876-9690-3778a818596a-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Acquiring lock "cinder-a92d07cb-ab21-4494-a512-8039f9adab4c-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Lock "cinder-a92d07cb-ab21-4494-a512-8039f9adab4c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] remove_export for volume: a92d07cb-ab21-4494-a512-8039f9adab4c. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:45Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-1404991775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a92d07cb-ab21-4494-a512-8039f9adab4c,launched_at=2023-04-14T02:03:47Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f51e87de64f4ef69ca2fc3db8471249',provider_auth='CHAP OumrNXlo RFsniGBr3gdCVI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:45Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:03:54Z,updated_at=2023-04-14T02:03:54Z,use_quota=True,user_id='01160f5736fb4e5cad73f585040229a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] detach volume v_a92d07cb-ab21-4494-a512-8039f9adab4c from target iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c/luns/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c/luns/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c/luns/v_a92d07cb-ab21-4494-a512-8039f9adab4c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c/luns/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c because of JDSS resource v_a92d07cb-ab21-4494-a512-8039f9adab4c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] delete target: iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] delete target iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] failed to remove resource iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c because of JDSS resource iqn.2010-10.org.openstack:a92d07cb-ab21-4494-a512-8039f9adab4c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] deleating volume v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] get snapshots for volume v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] get volume v_a92d07cb-ab21-4494-a512-8039f9adab4c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439235', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111389', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14627657978583368859', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c7a726106cc9f5f0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293383168', 'san:volume_id': 'c7a726106cc9f5f087d18fae9cd9a2e4b1c920f5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82219', 'name': 'v_a92d07cb-ab21-4494-a512-8039f9adab4c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] delete snapshot v_a92d07cb-ab21-4494-a512-8039f9adab4c of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_a92d07cb-ab21-4494-a512-8039f9adab4c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] snapshot v_a92d07cb-ab21-4494-a512-8039f9adab4c deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.quota [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Created reservations ['a0b751a8-c5c4-47d0-8b22-50730b5e73e4', 'd1d8d286-9dbf-440c-90e1-93cb7355c354', '649eec4c-a89f-4570-b6db-37bc1f2c1f74', '3e5e2a99-93e2-44e1-b8e9-cd328d7f2b53'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293420032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.manager [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:03:56 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Deleted volume successfully. Apr 14 02:03:56 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f0fdab2c-73e1-49cd-a2fc-509b4a0b929a tempest-VolumesGetTest-1669783756 None] Lock "cinder-a92d07cb-ab21-4494-a512-8039f9adab4c-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Acquiring lock "cinder-41242a52-99d3-435b-aef0-48d05e966fc0-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Lock "cinder-41242a52-99d3-435b-aef0-48d05e966fc0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=30,cinder:SELECT=57,cinder:INSERT=12,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] remove_export for volume: 41242a52-99d3-435b-aef0-48d05e966fc0. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2142718081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=41242a52-99d3-435b-aef0-48d05e966fc0,launched_at=2023-04-14T02:02:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth='CHAP YyfdkZNQ Wh8qTFM6GbC75i',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:58Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:04:06Z,updated_at=2023-04-14T02:04:06Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] detach volume v_41242a52-99d3-435b-aef0-48d05e966fc0 from target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns/v_41242a52-99d3-435b-aef0-48d05e966fc0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0/luns/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] failed to remove resource iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 because of JDSS resource v_41242a52-99d3-435b-aef0-48d05e966fc0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] delete target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] delete target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] failed to remove resource iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 because of JDSS resource iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] deleating volume v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] get snapshots for volume v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] get volume v_41242a52-99d3-435b-aef0-48d05e966fc0 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_41242a52-99d3-435b-aef0-48d05e966fc0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439187', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111329', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10486451007151597720', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3f12f72a5dece280', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293420032', 'san:volume_id': '3f12f72a5dece2806d0a0c6461a7451cd0175bb1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83106', 'name': 'v_41242a52-99d3-435b-aef0-48d05e966fc0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] delete volume:v_41242a52-99d3-435b-aef0-48d05e966fc0 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_41242a52-99d3-435b-aef0-48d05e966fc0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] volume v_41242a52-99d3-435b-aef0-48d05e966fc0 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.quota [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Created reservations ['20bf95fe-0195-495d-a671-c8c978ac509c', 'ffbedc9b-fc6c-4aff-8587-9fa546883b4c', '2dc93706-b3c9-4fd4-bec0-784cb8cb4543', '70232834-ee20-4d61-a82e-4b60bacd85a8'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293510144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.manager [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:04:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Deleted volume successfully. Apr 14 02:04:08 user cinder-volume[73579]: DEBUG cinder.coordination [None req-34160e36-d748-4291-a2de-4047edf96fca tempest-AttachVolumeTestJSON-296004410 None] Lock "cinder-41242a52-99d3-435b-aef0-48d05e966fc0-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Acquiring lock "cinder-97ad20ea-9d0f-482a-944e-c43cdf18b5aa-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Lock "cinder-97ad20ea-9d0f-482a-944e-c43cdf18b5aa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] remove_export for volume: 97ad20ea-9d0f-482a-944e-c43cdf18b5aa. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-842000716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=97ad20ea-9d0f-482a-944e-c43cdf18b5aa,launched_at=2023-04-14T02:02:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth='CHAP hlmbKWiI ne8oY1mVO9XIWC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:47Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:04:09Z,updated_at=2023-04-14T02:04:09Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] detach volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa from target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa/luns/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] failed to remove resource iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa because of JDSS resource v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] delete target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] delete target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] failed to remove resource iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa because of JDSS resource iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] deleating volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] get snapshots for volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] get volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439176', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111320', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4452178309739745500', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bc5c06080316dfc9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293510144', 'san:volume_id': 'bc5c06080316dfc9442f6e205a85e05a46641fc1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82402', 'name': 'v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] delete volume:v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] volume v_97ad20ea-9d0f-482a-944e-c43cdf18b5aa deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG cinder.quota [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Created reservations ['e07afe5c-5ae3-40ec-91b3-82f191d63ff5', '97ba581b-0a2f-414b-b556-4277cec6c4f1', '53746934-01ef-4fe9-9164-031a51783227', 'd34e7ba8-77f7-4734-ae15-af34811d7864'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=61,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293604352', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.manager [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:04:12 user cinder-volume[73579]: INFO cinder.volume.manager [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Deleted volume successfully. Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-69dda042-7da5-4d91-ae3d-a878f7db68e7 tempest-AttachVolumeTestJSON-296004410 None] Lock "cinder-97ad20ea-9d0f-482a-944e-c43cdf18b5aa-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Acquiring lock "cinder-4d2a082d-59f8-4081-9ace-fc3ae1219b10-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Lock "cinder-4d2a082d-59f8-4081-9ace-fc3ae1219b10-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] remove_export for volume: 4d2a082d-59f8-4081-9ace-fc3ae1219b10. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1381772145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4d2a082d-59f8-4081-9ace-fc3ae1219b10,launched_at=2023-04-14T01:52:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f650e04d2c947498b9e7a8d002862ad',provider_auth='CHAP txGYAkUr edHrm6CkSPIuZc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:52:25Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:04:12Z,updated_at=2023-04-14T02:04:12Z,use_quota=True,user_id='ba0894753a074f99ab226fde0565dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] detach volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 from target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10/luns/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] failed to remove resource iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 because of JDSS resource v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] delete target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] delete target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] failed to remove resource iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 because of JDSS resource iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] deleating volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] get snapshots for volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] get volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438554', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111029', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1321028496115459305', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '157c163aba9de129', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293604352', 'san:volume_id': '157c163aba9de129a59107fbfedc546f68dbc2e6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82347', 'name': 'v_4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] delete volume:v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] volume v_4d2a082d-59f8-4081-9ace-fc3ae1219b10 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:04:14 user cinder-volume[73579]: DEBUG cinder.quota [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Created reservations ['ff6db110-ce94-472a-9c8d-29ec06efcce3', '4f2c87f0-eb67-49c7-aa81-deb26eff4159', '861ff900-fb36-433c-97c9-507f14efd5d9', 'c862a303-483b-4886-ab99-a617ff273c2a'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:04:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:04:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293686272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:04:15 user cinder-volume[73579]: DEBUG cinder.manager [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:04:15 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Deleted volume successfully. Apr 14 02:04:15 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e38e4dba-9d2e-4327-bfd9-9802d3644f0c tempest-AttachVolumeTestJSON-296004410 None] Lock "cinder-4d2a082d-59f8-4081-9ace-fc3ae1219b10-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] create export for volume: d6e664bf-00ef-4bb1-835c-e96535d4bb32. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] ensure volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] check if targe iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] create target and attach volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] create target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-036e98cb-f2a3-4c8a-ad80-85ea75380ed8 tempest-GroupSnapshotsTest-1844706491 None] Group tempest-GroupSnapshotsTest-Group-713979465: creating Apr 14 02:04:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-036e98cb-f2a3-4c8a-ad80-85ea75380ed8 tempest-GroupSnapshotsTest-1844706491 None] Group tempest-GroupSnapshotsTest-Group-713979465: created successfully Apr 14 02:04:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-036e98cb-f2a3-4c8a-ad80-85ea75380ed8 tempest-GroupSnapshotsTest-1844706491 None] Create group completed successfully. Apr 14 02:04:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] atach volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 to target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:04:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (918b1116-1fef-4eea-8a17-f5316f405868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27fe702-5ea1-44ba-b67b-2c32b33fb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27fe702-5ea1-44ba-b67b-2c32b33fb352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808475891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20ff709c-4722-4e49-adeb-5164ccb1f7e0,host='user@joviandss-2#joviandss-2',id=cef4e667-5212-4f8f-9e77-b2ca874151a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:04:23Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c90e0b02-960b-4914-a164-279edd465754),volume_type_id=c90e0b02-960b-4914-a164-279edd465754)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76657c9b-b925-47ed-bf6f-038479504e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76657c9b-b925-47ed-bf6f-038479504e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89eb2954-6d20-4745-b3e5-27cf6c18eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89eb2954-6d20-4745-b3e5-27cf6c18eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef4e667-5212-4f8f-9e77-b2ca874151a9', 'volume_name': 'volume-cef4e667-5212-4f8f-9e77-b2ca874151a9', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3609c-7b0c-4593-a2c0-faead2830fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3609c-7b0c-4593-a2c0-faead2830fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b7845e-5ef6-4369-a651-322c76f3ba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Volume cef4e667-5212-4f8f-9e77-b2ca874151a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef4e667-5212-4f8f-9e77-b2ca874151a9', 'volume_size': 1} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] creating volume v_cef4e667-5212-4f8f-9e77-b2ca874151a9. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] create volume {'name': 'v_cef4e667-5212-4f8f-9e77-b2ca874151a9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6331396262623731', 'lun': 0, 'mode': 'wt', 'name': 'v_d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'prod_id': 'Storage', 'scsi_id': 'c19bbb716869c319'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] add credentails to target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': {'name': 'kUVxZKGQ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] initialize_connection for d6e664bf-00ef-4bb1-835c-e96535d4bb32 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUVxZKGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '52065cbd-7ce3-4464-b6e9-9a35eb4e396e'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:04:24 user cinder-volume[73579]: INFO cinder.volume.manager [req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 req-6c6ce4e9-226d-41b6-9a75-57c5cca4c449 tempest-TestStampPattern-190654074 None] attachment_update completed successfully. Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_cef4e667-5212-4f8f-9e77-b2ca874151a9', 'is_clone': False, 'name': 'v_cef4e667-5212-4f8f-9e77-b2ca874151a9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b7845e-5ef6-4369-a651-322c76f3ba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef4e667-5212-4f8f-9e77-b2ca874151a9', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeeeaed-d23b-4b43-ac19-7cdd35586a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Volume volume-cef4e667-5212-4f8f-9e77-b2ca874151a9 (cef4e667-5212-4f8f-9e77-b2ca874151a9): created successfully Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeeeaed-d23b-4b43-ac19-7cdd35586a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (918b1116-1fef-4eea-8a17-f5316f405868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:04:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0cde0309-9b61-476d-9872-1071982a6258 tempest-GroupSnapshotsTest-1844706491 None] Created volume successfully. Apr 14 02:04:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] GroupSnapshot 69376779-68de-4864-9443-136f8072aebe: creating. Apr 14 02:04:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Group snapshot 69376779-68de-4864-9443-136f8072aebe: creating. {{(pid=73579) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 02:04:25 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] create snapshot edcd5d59-9f18-4a92-b28b-8688bd7b908e for volume cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:04:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] cloning v_cef4e667-5212-4f8f-9e77-b2ca874151a9 to s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:04:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] create snapshot s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:04:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_edcd5d59-9f18-4a92-b28b-8688bd7b908e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] create volume s_edcd5d59-9f18-4a92-b28b-8688bd7b908e from snapshot s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:04:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_cef4e667-5212-4f8f-9e77-b2ca874151a9@s_edcd5d59-9f18-4a92-b28b-8688bd7b908e', 'is_clone': True, 'full_name': 'Pool-0/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e', 'name': 's_edcd5d59-9f18-4a92-b28b-8688bd7b908e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] volume s_edcd5d59-9f18-4a92-b28b-8688bd7b908e properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:04:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a49ae8fc-65bf-4e98-9ccc-69cb29638128 tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 69376779-68de-4864-9443-136f8072aebe: created successfully Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] create volume 20dbd33f-fa15-4fb5-be7d-70e1bc913b80 from snapshot edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] cloning s_edcd5d59-9f18-4a92-b28b-8688bd7b908e to v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] create snapshot v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] terminate connection for d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:04:29 user cinder-volume[73579]: INFO cinder.volume.manager [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Terminate volume connection completed successfully. Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Deleting attachment 52065cbd-7ce3-4464-b6e9-9a35eb4e396e. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] remove_export for volume: d6e664bf-00ef-4bb1-835c-e96535d4bb32. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-952640453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d6e664bf-00ef-4bb1-835c-e96535d4bb32,launched_at=2023-04-14T02:02:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='27dc405e16434633956ed2cd7e1791cd',provider_auth='CHAP kUVxZKGQ WHSTJngefFqcaR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:04:28Z,use_quota=True,user_id='7ae5170969344b9fa5294231f8ffbe72',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] detach volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 from target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] delete target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] delete target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 req-c6e9db83-fb20-4af1-ae00-4ca5b4128aae tempest-TestStampPattern-190654074 None] target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] create volume v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 from snapshot v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e@v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'is_clone': True, 'full_name': 'Pool-0/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'name': 'v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] get volume v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e@v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439279', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111428', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1403175723571468811', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '00e8f192cfeb8e66', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293436416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82247', 'name': 'v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6245817e-8a1e-4310-94ac-40a1f0a4ff6f tempest-GroupSnapshotsTest-1844706491 None] Create group from source-snapshot-69376779-68de-4864-9443-136f8072aebe completed successfully. Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293436416', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] remove_export for volume: 20dbd33f-fa15-4fb5-be7d-70e1bc913b80. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ae21cce-b3b7-4efa-a8ec-3eea8dc212ea,host='user@joviandss-2#joviandss-2',id=20dbd33f-fa15-4fb5-be7d-70e1bc913b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth='CHAP MySbedZP OSe6Pj1NE8GuH2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=edcd5d59-9f18-4a92-b28b-8688bd7b908e,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T02:04:32Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c90e0b02-960b-4914-a164-279edd465754),volume_type_id=c90e0b02-960b-4914-a164-279edd465754) from target:iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] detach volume v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 from target iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80/luns/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80/luns/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80/luns/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80/luns/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 because of JDSS resource v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] delete target: iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] delete target iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 because of JDSS resource iqn.2010-10.org.openstack:20dbd33f-fa15-4fb5-be7d-70e1bc913b80 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] deleating volume v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] get volume v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e@v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439279', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111428', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1403175723571468811', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '00e8f192cfeb8e66', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293424128', 'san:volume_id': '00e8f192cfeb8e66f7eb73e12d6bee2b8a7a5357', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82247', 'name': 'v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] delete snapshot v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 of volume s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots/v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] snapshot v_20dbd33f-fa15-4fb5-be7d-70e1bc913b80 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:04:33 user cinder-volume[73579]: DEBUG cinder.quota [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['3d942cb9-22bc-458b-a91c-176449973bb9'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:34 user cinder-volume[73579]: WARNING cinder.quota [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1996877275 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1996877275, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:04:34 user cinder-volume[73579]: WARNING cinder.quota [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1996877275 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1996877275, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.quota [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['6b796015-7eb1-474b-be68-d583c9b587c6', 'bc0306c3-f799-4b58-9701-e34bf1c5fec3', 'ca010c40-8f4f-4433-8e59-96c35e1e26ab', '85aa9f46-bd9a-4fe7-a25e-de9892691a6d'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=75,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:34 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 69376779-68de-4864-9443-136f8072aebe: deleting Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 69376779-68de-4864-9443-136f8072aebe: deleting {{(pid=73579) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] deleating snapshot s_edcd5d59-9f18-4a92-b28b-8688bd7b908e. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293436416', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.manager [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:04:34 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8e94f32e-00b6-4a4b-8afd-22dee583f0d7 tempest-GroupSnapshotsTest-1844706491 None] Delete group completed successfully. Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] get volume s_edcd5d59-9f18-4a92-b28b-8688bd7b908e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_cef4e667-5212-4f8f-9e77-b2ca874151a9@s_edcd5d59-9f18-4a92-b28b-8688bd7b908e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439276', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111417', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17648944924271750168', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ee023f76a22c2dc2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293436416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83483', 'name': 's_edcd5d59-9f18-4a92-b28b-8688bd7b908e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] delete snapshot s_edcd5d59-9f18-4a92-b28b-8688bd7b908e of volume v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots/s_edcd5d59-9f18-4a92-b28b-8688bd7b908e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] snapshot s_edcd5d59-9f18-4a92-b28b-8688bd7b908e deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:04:36 user cinder-volume[73579]: WARNING cinder.quota [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1996877275 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1996877275, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.quota [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['b3640a6f-ca2b-49a6-9bad-3f3911f225d4', '41999382-a433-4a9f-bb4e-ed20602928ed', '86ee1229-c259-4576-8986-0e3435b06d1d', 'd8e2cc1e-42b5-4069-b9b3-54e9ea27c547'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:36 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3a8d1f5f-e710-4561-bc67-a86515b32a49 tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 69376779-68de-4864-9443-136f8072aebe: deleted successfully Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] remove_export for volume: cef4e667-5212-4f8f-9e77-b2ca874151a9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808475891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20ff709c-4722-4e49-adeb-5164ccb1f7e0,host='user@joviandss-2#joviandss-2',id=cef4e667-5212-4f8f-9e77-b2ca874151a9,launched_at=2023-04-14T02:04:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth='CHAP fkJLEOmX 4TCgDOazmdh6U2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:04:23Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T02:04:37Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c90e0b02-960b-4914-a164-279edd465754),volume_type_id=c90e0b02-960b-4914-a164-279edd465754) from target:iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] detach volume v_cef4e667-5212-4f8f-9e77-b2ca874151a9 from target iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9/luns/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9/luns/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9/luns/v_cef4e667-5212-4f8f-9e77-b2ca874151a9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9/luns/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 because of JDSS resource v_cef4e667-5212-4f8f-9e77-b2ca874151a9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] delete target: iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] delete target iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 because of JDSS resource iqn.2010-10.org.openstack:cef4e667-5212-4f8f-9e77-b2ca874151a9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] deleating volume v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] get volume v_cef4e667-5212-4f8f-9e77-b2ca874151a9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cef4e667-5212-4f8f-9e77-b2ca874151a9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439273', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111411', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16825178964178638213', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '74ab4d9846f48b26', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293460992', 'san:volume_id': '74ab4d9846f48b26ae5788b82790319e1ee2db70', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83615', 'name': 'v_cef4e667-5212-4f8f-9e77-b2ca874151a9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] delete volume:v_cef4e667-5212-4f8f-9e77-b2ca874151a9 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cef4e667-5212-4f8f-9e77-b2ca874151a9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] volume v_cef4e667-5212-4f8f-9e77-b2ca874151a9 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.quota [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['4c5b58a5-13b3-4eb8-9c40-9f54cd9694bf'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:39 user cinder-volume[73579]: WARNING cinder.db.sqlalchemy.api [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1996877275'] Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.quota [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['cfce78aa-d979-44dc-9834-cee6254798d2', '70bc7a1a-4c58-4ec2-aa31-7fd561a0d289', '42718350-79b2-42a0-a6a8-b092a1a33e63', 'e99a33e7-12ae-4a99-a2ce-b09a3951ef6a'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=62,cinder:UPDATE=32,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293555200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:04:39 user cinder-volume[73579]: DEBUG cinder.manager [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:04:39 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d40eee6a-6236-499b-8580-117eeab3a5ba tempest-GroupSnapshotsTest-1844706491 None] Delete group completed successfully. Apr 14 02:04:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-852d7f13-6f63-449e-9b16-05822b2c5b53 tempest-GroupSnapshotsTest-1844706491 None] Group tempest-GroupSnapshotsTest-Group-1381472870: creating Apr 14 02:04:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-852d7f13-6f63-449e-9b16-05822b2c5b53 tempest-GroupSnapshotsTest-1844706491 None] Group tempest-GroupSnapshotsTest-Group-1381472870: created successfully Apr 14 02:04:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-852d7f13-6f63-449e-9b16-05822b2c5b53 tempest-GroupSnapshotsTest-1844706491 None] Create group completed successfully. Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (5bb5858c-a2d8-463c-b2b0-2e18e0a9ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b281638b-c229-4535-bfe8-09b43d0ba9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b281638b-c229-4535-bfe8-09b43d0ba9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697653716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cb95c25-b3cd-41f1-894e-10a44fb7f6da,host='user@joviandss-2#joviandss-2',id=65ae3994-4e31-4efb-995e-b3ce4e3d3a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:04:42Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293b164e-bd7e-4c59-aa3c-2c3ecc538553),volume_type_id=293b164e-bd7e-4c59-aa3c-2c3ecc538553)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc13593-7528-4d0d-a7a7-83003b354751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc13593-7528-4d0d-a7a7-83003b354751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217c58ee-23d2-4751-8daa-d18d00a624c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217c58ee-23d2-4751-8daa-d18d00a624c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'volume_name': 'volume-65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a97dd7-9b14-4c02-a832-93f4666eefff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a97dd7-9b14-4c02-a832-93f4666eefff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb884df-d7b8-4928-8974-cc5547f56687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:41 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Volume 65ae3994-4e31-4efb-995e-b3ce4e3d3a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'volume_size': 1} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] creating volume v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] create volume {'name': 'v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'is_clone': False, 'name': 'v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb884df-d7b8-4928-8974-cc5547f56687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7182261e-d81d-4559-b6b7-28e5f50bb36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:42 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Volume volume-65ae3994-4e31-4efb-995e-b3ce4e3d3a15 (65ae3994-4e31-4efb-995e-b3ce4e3d3a15): created successfully Apr 14 02:04:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7182261e-d81d-4559-b6b7-28e5f50bb36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (5bb5858c-a2d8-463c-b2b0-2e18e0a9ab29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:04:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c0a3e356-43ae-4b68-9435-56441a448085 tempest-GroupSnapshotsTest-1844706491 None] Created volume successfully. Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (ce7aedb9-4949-433b-b951-947d21ecb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6963aa-6f71-4344-8c20-778ea5d4f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6963aa-6f71-4344-8c20-778ea5d4f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012636950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cb95c25-b3cd-41f1-894e-10a44fb7f6da,host='user@joviandss-2#joviandss-2',id=136728e7-687f-4caf-9e7f-e33c6a7dd476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:04:43Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293b164e-bd7e-4c59-aa3c-2c3ecc538553),volume_type_id=293b164e-bd7e-4c59-aa3c-2c3ecc538553)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8637c39-48ac-4a71-b9ba-e6a9c3a47850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8637c39-48ac-4a71-b9ba-e6a9c3a47850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7ce8f2-9ae6-4219-9ae8-84e1981b7ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7ce8f2-9ae6-4219-9ae8-84e1981b7ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136728e7-687f-4caf-9e7f-e33c6a7dd476', 'volume_name': 'volume-136728e7-687f-4caf-9e7f-e33c6a7dd476', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ff0aff-8272-462e-a59e-1968f2acdb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ff0aff-8272-462e-a59e-1968f2acdb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969b11cb-bb01-4fbd-b94f-1f83d85a10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Volume 136728e7-687f-4caf-9e7f-e33c6a7dd476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136728e7-687f-4caf-9e7f-e33c6a7dd476', 'volume_size': 1} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] creating volume v_136728e7-687f-4caf-9e7f-e33c6a7dd476. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] create volume {'name': 'v_136728e7-687f-4caf-9e7f-e33c6a7dd476', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_136728e7-687f-4caf-9e7f-e33c6a7dd476', 'is_clone': False, 'name': 'v_136728e7-687f-4caf-9e7f-e33c6a7dd476'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969b11cb-bb01-4fbd-b94f-1f83d85a10b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136728e7-687f-4caf-9e7f-e33c6a7dd476', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf97f5d-0d27-45a3-8aff-d738dc7d1983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:04:44 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Volume volume-136728e7-687f-4caf-9e7f-e33c6a7dd476 (136728e7-687f-4caf-9e7f-e33c6a7dd476): created successfully Apr 14 02:04:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf97f5d-0d27-45a3-8aff-d738dc7d1983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:04:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (ce7aedb9-4949-433b-b951-947d21ecb03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:04:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3680596e-d57f-4492-82bb-064e8bb42681 tempest-GroupSnapshotsTest-1844706491 None] Created volume successfully. Apr 14 02:04:45 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f22580dc-1598-47a0-aa63-973eb6a8ed0b tempest-GroupSnapshotsTest-1844706491 None] Update group completed successfully. Apr 14 02:04:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a1f054c5-c018-41f6-b54f-f88d18cb3998 tempest-GroupSnapshotsTest-1844706491 None] Update group completed successfully. Apr 14 02:04:47 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=33,cinder:SELECT=60,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:47 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0022c003-58a3-4815-ae51-cea1b6bd03f9 tempest-GroupSnapshotsTest-1844706491 None] Update group completed successfully. Apr 14 02:04:48 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3546d54a-bb7d-4454-b29c-68d42fd1be8a tempest-GroupSnapshotsTest-1844706491 None] Update group completed successfully. Apr 14 02:04:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] GroupSnapshot 38596606-6b38-42f4-802e-2b908f4755d8: creating. Apr 14 02:04:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Group snapshot 38596606-6b38-42f4-802e-2b908f4755d8: creating. {{(pid=73579) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 02:04:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] create snapshot 0babf3fb-42ad-46b7-bbde-168115e55702 for volume 65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:04:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] cloning v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 to s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:04:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] create snapshot s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:04:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_0babf3fb-42ad-46b7-bbde-168115e55702'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] create volume s_0babf3fb-42ad-46b7-bbde-168115e55702 from snapshot s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:04:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15@s_0babf3fb-42ad-46b7-bbde-168115e55702', 'is_clone': True, 'full_name': 'Pool-0/s_0babf3fb-42ad-46b7-bbde-168115e55702', 'name': 's_0babf3fb-42ad-46b7-bbde-168115e55702'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] volume s_0babf3fb-42ad-46b7-bbde-168115e55702 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] create snapshot 912e1306-9541-49b0-8c1d-c3714a05b6b5 for volume 136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] cloning v_136728e7-687f-4caf-9e7f-e33c6a7dd476 to s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] create snapshot s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_912e1306-9541-49b0-8c1d-c3714a05b6b5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] create volume s_912e1306-9541-49b0-8c1d-c3714a05b6b5 from snapshot s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:04:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_136728e7-687f-4caf-9e7f-e33c6a7dd476@s_912e1306-9541-49b0-8c1d-c3714a05b6b5', 'is_clone': True, 'full_name': 'Pool-0/s_912e1306-9541-49b0-8c1d-c3714a05b6b5', 'name': 's_912e1306-9541-49b0-8c1d-c3714a05b6b5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] volume s_912e1306-9541-49b0-8c1d-c3714a05b6b5 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:04:54 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9a5ef0bf-ab9a-4ee2-a852-ce8263b1f39e tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 38596606-6b38-42f4-802e-2b908f4755d8: created successfully Apr 14 02:04:54 user cinder-volume[73579]: INFO cinder.volume.manager [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 38596606-6b38-42f4-802e-2b908f4755d8: deleting Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 38596606-6b38-42f4-802e-2b908f4755d8: deleting {{(pid=73579) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] deleating snapshot s_0babf3fb-42ad-46b7-bbde-168115e55702. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] get volume s_0babf3fb-42ad-46b7-bbde-168115e55702 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15@s_0babf3fb-42ad-46b7-bbde-168115e55702', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_0babf3fb-42ad-46b7-bbde-168115e55702', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439300', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111451', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10738258555987324595', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4fca3efd7a7b2aaf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293366784', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83494', 'name': 's_0babf3fb-42ad-46b7-bbde-168115e55702', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] delete snapshot s_0babf3fb-42ad-46b7-bbde-168115e55702 of volume v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots/s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots/s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots/s_0babf3fb-42ad-46b7-bbde-168115e55702 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] snapshot s_0babf3fb-42ad-46b7-bbde-168115e55702 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:04:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] deleating snapshot s_912e1306-9541-49b0-8c1d-c3714a05b6b5. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:04:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] get volume s_912e1306-9541-49b0-8c1d-c3714a05b6b5 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_136728e7-687f-4caf-9e7f-e33c6a7dd476@s_912e1306-9541-49b0-8c1d-c3714a05b6b5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_912e1306-9541-49b0-8c1d-c3714a05b6b5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439302', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111457', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2917264367336124460', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '77a3cce35798cb90', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293366784', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83510', 'name': 's_912e1306-9541-49b0-8c1d-c3714a05b6b5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] delete snapshot s_912e1306-9541-49b0-8c1d-c3714a05b6b5 of volume v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots/s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots/s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots/s_912e1306-9541-49b0-8c1d-c3714a05b6b5 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] snapshot s_912e1306-9541-49b0-8c1d-c3714a05b6b5 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:04:58 user cinder-volume[73579]: WARNING cinder.quota [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-426392717 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-426392717, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:04:58 user cinder-volume[73579]: WARNING cinder.quota [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-426392717 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-426392717, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:04:58 user cinder-volume[73579]: DEBUG cinder.quota [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['cc09230b-71b3-4bdf-8ee0-0b4ede091065', '2214db79-d58e-4823-b2fb-29dc17b67455', 'f961f742-4586-4403-9894-952a2cae24f3', 'c3e698c6-f6f0-4d4b-9a7a-46cb274b09c8'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:58 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=74,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:58 user cinder-volume[73579]: DEBUG cinder.quota [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['44228fb3-f5e2-4c00-8a93-47401a51619d', '0671d69e-ddc7-4615-85ab-3f761793035a', '55bd1598-12e3-49ce-a3e8-d7a1ec8c5f2f', 'e03c5b8e-d34e-4c3d-bc68-89bbdd120c07'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:04:58 user cinder-volume[73579]: INFO cinder.volume.manager [None req-87c85bd3-f1c1-4f96-bc78-e8f6c1f5baad tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 38596606-6b38-42f4-802e-2b908f4755d8: deleted successfully Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] remove_export for volume: 136728e7-687f-4caf-9e7f-e33c6a7dd476. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012636950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cb95c25-b3cd-41f1-894e-10a44fb7f6da,host='user@joviandss-2#joviandss-2',id=136728e7-687f-4caf-9e7f-e33c6a7dd476,launched_at=2023-04-14T02:04:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth='CHAP WZMVxBGC psOo8cRLaJkQmf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:04:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T02:04:59Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293b164e-bd7e-4c59-aa3c-2c3ecc538553),volume_type_id=293b164e-bd7e-4c59-aa3c-2c3ecc538553) from target:iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] detach volume v_136728e7-687f-4caf-9e7f-e33c6a7dd476 from target iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476/luns/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476/luns/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476/luns/v_136728e7-687f-4caf-9e7f-e33c6a7dd476'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476/luns/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 because of JDSS resource v_136728e7-687f-4caf-9e7f-e33c6a7dd476 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] delete target: iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] delete target iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 because of JDSS resource iqn.2010-10.org.openstack:136728e7-687f-4caf-9e7f-e33c6a7dd476 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] deleating volume v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] get volume v_136728e7-687f-4caf-9e7f-e33c6a7dd476 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_136728e7-687f-4caf-9e7f-e33c6a7dd476', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439292', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111444', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15114020457784460176', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '73110a509a165de4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293366784', 'san:volume_id': '73110a509a165de4d46945b1712caba74f713a1c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82940', 'name': 'v_136728e7-687f-4caf-9e7f-e33c6a7dd476', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] delete volume:v_136728e7-687f-4caf-9e7f-e33c6a7dd476 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:04:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_136728e7-687f-4caf-9e7f-e33c6a7dd476 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] volume v_136728e7-687f-4caf-9e7f-e33c6a7dd476 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] remove_export for volume: 65ae3994-4e31-4efb-995e-b3ce4e3d3a15. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697653716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cb95c25-b3cd-41f1-894e-10a44fb7f6da,host='user@joviandss-2#joviandss-2',id=65ae3994-4e31-4efb-995e-b3ce4e3d3a15,launched_at=2023-04-14T02:04:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth='CHAP EDjJqfGz kMt1wPbZRY7Hqp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:04:42Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T02:04:59Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293b164e-bd7e-4c59-aa3c-2c3ecc538553),volume_type_id=293b164e-bd7e-4c59-aa3c-2c3ecc538553) from target:iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] detach volume v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 from target iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15/luns/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15/luns/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15/luns/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15/luns/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 because of JDSS resource v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] delete target: iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] delete target iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 because of JDSS resource iqn.2010-10.org.openstack:65ae3994-4e31-4efb-995e-b3ce4e3d3a15 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] deleating volume v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] get volume v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439291', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111440', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10841220184817410197', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b18b21495de5b31e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293448704', 'san:volume_id': 'b18b21495de5b31edc4888cf591bb09dc09beeaa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83032', 'name': 'v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] delete volume:v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] volume v_65ae3994-4e31-4efb-995e-b3ce4e3d3a15 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.quota [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['dd12ab98-2eb8-47b7-93bc-a2b14cd00056'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:03 user cinder-volume[73579]: WARNING cinder.quota [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-426392717 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-426392717, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.quota [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['5f5219ae-46d4-4276-8271-125c85479e73', '89be2944-c4e2-4f8b-bd0b-ea922e08a107', '31905dda-61d1-4269-9ff3-28d26dd3ec6b', 'bbfac4a5-f811-47c0-b88d-5a17614de7ee'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.quota [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['1e39f30c-ec14-4391-8fbe-23c04cc4e1c8', '4242d86b-2efe-4a09-a241-79c3f0105373', 'b26a71a8-2cdc-46df-a739-f36c395fe51e', 'f5a2598d-9f48-46a2-addd-f379dfcb637a'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=68,cinder:UPDATE=26,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293530624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:05:04 user cinder-volume[73579]: DEBUG cinder.manager [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:05:04 user cinder-volume[73579]: INFO cinder.volume.manager [None req-be32cee8-5476-49a4-ad51-85e382f3fcf0 tempest-GroupSnapshotsTest-1844706491 None] Delete group completed successfully. Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] create export for volume: 8e30d5da-2923-47a9-9cb1-98605d191299. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] ensure volume 8e30d5da-2923-47a9-9cb1-98605d191299 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] check if targe iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b763eddf-718a-42c0-ac9a-1ef96998e581 tempest-GroupSnapshotsTest-1844706491 None] Group tempest-GroupSnapshotsTest-Group-180925332: creating Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] create target and attach volume 8e30d5da-2923-47a9-9cb1-98605d191299 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] create target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b763eddf-718a-42c0-ac9a-1ef96998e581 tempest-GroupSnapshotsTest-1844706491 None] Group tempest-GroupSnapshotsTest-Group-180925332: created successfully Apr 14 02:05:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b763eddf-718a-42c0-ac9a-1ef96998e581 tempest-GroupSnapshotsTest-1844706491 None] Create group completed successfully. Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (f4a80d8b-bcea-47ca-8f29-a7c5af53bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28213000-8d80-4e9d-9237-33d9029e5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28213000-8d80-4e9d-9237-33d9029e5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655932636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5485cd20-d91e-4c27-a58a-9a3f130a2f2d,host='user@joviandss-2#joviandss-2',id=b212f8a6-6328-4f58-a277-0330b0519b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:05:06Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7879faea-114f-4bcf-a294-92d1d9f6caad),volume_type_id=7879faea-114f-4bcf-a294-92d1d9f6caad)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8db55b5-9954-436c-9af5-5395deb312b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8db55b5-9954-436c-9af5-5395deb312b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156c5dcd-6c08-4d5c-ba9d-8275cf15f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156c5dcd-6c08-4d5c-ba9d-8275cf15f343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b212f8a6-6328-4f58-a277-0330b0519b07', 'volume_name': 'volume-b212f8a6-6328-4f58-a277-0330b0519b07', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef3176c-0d07-4bf4-a550-674130a242da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef3176c-0d07-4bf4-a550-674130a242da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a331678-15d1-4bd0-875c-e1009352cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:06 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Volume b212f8a6-6328-4f58-a277-0330b0519b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b212f8a6-6328-4f58-a277-0330b0519b07', 'volume_size': 1} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] creating volume v_b212f8a6-6328-4f58-a277-0330b0519b07. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] create volume {'name': 'v_b212f8a6-6328-4f58-a277-0330b0519b07', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b212f8a6-6328-4f58-a277-0330b0519b07', 'is_clone': False, 'name': 'v_b212f8a6-6328-4f58-a277-0330b0519b07'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a331678-15d1-4bd0-875c-e1009352cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b212f8a6-6328-4f58-a277-0330b0519b07', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23af1877-ddeb-4df7-8329-869c4bd09e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:07 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Volume volume-b212f8a6-6328-4f58-a277-0330b0519b07 (b212f8a6-6328-4f58-a277-0330b0519b07): created successfully Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23af1877-ddeb-4df7-8329-869c4bd09e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Flow 'volume_create_manager' (f4a80d8b-bcea-47ca-8f29-a7c5af53bafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ef3a5a81-870c-4196-afef-dd9a92e25c8c tempest-GroupSnapshotsTest-1844706491 None] Created volume successfully. Apr 14 02:05:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] GroupSnapshot 27d7678e-83ce-4e02-96b2-622a56155164: creating. Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] atach volume v_8e30d5da-2923-47a9-9cb1-98605d191299 to target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Group snapshot 27d7678e-83ce-4e02-96b2-622a56155164: creating. {{(pid=73579) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] create snapshot 88353835-9bee-4775-9891-5622f8f4db2f for volume b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] cloning v_b212f8a6-6328-4f58-a277-0330b0519b07 to s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] create snapshot s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_88353835-9bee-4775-9891-5622f8f4db2f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] create volume s_88353835-9bee-4775-9891-5622f8f4db2f from snapshot s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:05:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3633343431653232', 'lun': 0, 'mode': 'wt', 'name': 'v_8e30d5da-2923-47a9-9cb1-98605d191299', 'prod_id': 'Storage', 'scsi_id': '63441e22069ecf8c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] add credentails to target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'name': 'DXYiqSgT'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] initialize_connection for 8e30d5da-2923-47a9-9cb1-98605d191299 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXYiqSgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'cf83d7bc-4cd0-4862-96b5-4861b127ce25'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=59,cinder:INSERT=7,cinder:UPDATE=34 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:09 user cinder-volume[73579]: INFO cinder.volume.manager [req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f req-b02290b6-3cdb-4e73-9f76-106ca7a139cf tempest-VolumesSnapshotTestJSON-2121749885 None] attachment_update completed successfully. Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b212f8a6-6328-4f58-a277-0330b0519b07@s_88353835-9bee-4775-9891-5622f8f4db2f', 'is_clone': True, 'full_name': 'Pool-0/s_88353835-9bee-4775-9891-5622f8f4db2f', 'name': 's_88353835-9bee-4775-9891-5622f8f4db2f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] volume s_88353835-9bee-4775-9891-5622f8f4db2f properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:05:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5687b7d2-ee57-4612-9793-19aed5b8b92f tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 27d7678e-83ce-4e02-96b2-622a56155164: created successfully Apr 14 02:05:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 27d7678e-83ce-4e02-96b2-622a56155164: deleting Apr 14 02:05:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 27d7678e-83ce-4e02-96b2-622a56155164: deleting {{(pid=73579) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] deleating snapshot s_88353835-9bee-4775-9891-5622f8f4db2f. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] get volume s_88353835-9bee-4775-9891-5622f8f4db2f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b212f8a6-6328-4f58-a277-0330b0519b07@s_88353835-9bee-4775-9891-5622f8f4db2f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_88353835-9bee-4775-9891-5622f8f4db2f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439318', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111481', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10610081028936720301', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dd10a58026bc5f84', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293424128', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83054', 'name': 's_88353835-9bee-4775-9891-5622f8f4db2f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] delete snapshot s_88353835-9bee-4775-9891-5622f8f4db2f of volume v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots/s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots/s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot e852f67a-498c-4d67-9652-9accfe888431 for volume 8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:05:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_8e30d5da-2923-47a9-9cb1-98605d191299 to s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:05:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:05:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots/s_88353835-9bee-4775-9891-5622f8f4db2f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] snapshot s_88353835-9bee-4775-9891-5622f8f4db2f deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:05:12 user cinder-volume[73579]: WARNING cinder.quota [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1444976913 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1444976913, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:05:12 user cinder-volume[73579]: WARNING cinder.quota [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1444976913 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1444976913, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:05:12 user cinder-volume[73579]: DEBUG cinder.quota [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['64d64bd3-1851-409d-a05a-21f57c93370d', '4ab36dd6-d44e-45e1-b7b6-605b49f58a04', 'ba064c79-068d-4e8e-9e69-c0d5a36e7524', '00d7fe5b-b8ed-4309-be22-a286a4efdd1b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:12 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f9c6d637-7247-4d27-8e3c-8560293173e5 tempest-GroupSnapshotsTest-1844706491 None] group_snapshot 27d7678e-83ce-4e02-96b2-622a56155164: deleted successfully Apr 14 02:05:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e852f67a-498c-4d67-9652-9accfe888431'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_e852f67a-498c-4d67-9652-9accfe888431 from snapshot s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:05:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] remove_export for volume: b212f8a6-6328-4f58-a277-0330b0519b07. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655932636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5485cd20-d91e-4c27-a58a-9a3f130a2f2d,host='user@joviandss-2#joviandss-2',id=b212f8a6-6328-4f58-a277-0330b0519b07,launched_at=2023-04-14T02:05:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f46d1c5b7843d3a188001c08a53c3b',provider_auth='CHAP YilCuyFr PHh0vFTzN6Mye3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:06Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T02:05:13Z,use_quota=True,user_id='b58c86a6e5034da2ba90bea820871cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7879faea-114f-4bcf-a294-92d1d9f6caad),volume_type_id=7879faea-114f-4bcf-a294-92d1d9f6caad) from target:iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] detach volume v_b212f8a6-6328-4f58-a277-0330b0519b07 from target iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07/luns/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07/luns/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07/luns/v_b212f8a6-6328-4f58-a277-0330b0519b07'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07/luns/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 because of JDSS resource v_b212f8a6-6328-4f58-a277-0330b0519b07 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] delete target: iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] delete target iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] failed to remove resource iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 because of JDSS resource iqn.2010-10.org.openstack:b212f8a6-6328-4f58-a277-0330b0519b07 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] deleating volume v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] get snapshots for volume v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299@s_e852f67a-498c-4d67-9652-9accfe888431', 'is_clone': True, 'full_name': 'Pool-0/s_e852f67a-498c-4d67-9652-9accfe888431', 'name': 's_e852f67a-498c-4d67-9652-9accfe888431'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_e852f67a-498c-4d67-9652-9accfe888431 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:05:13 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e8485828-80b7-4c21-b07f-aa940f7dec38 tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot c6785eea-69fe-4667-8854-9474483bfff0 for volume 8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_8e30d5da-2923-47a9-9cb1-98605d191299 to s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] get volume v_b212f8a6-6328-4f58-a277-0330b0519b07 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b212f8a6-6328-4f58-a277-0330b0519b07', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439316', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111471', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3441538508478598291', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9359aa74fb572740', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293411840', 'san:volume_id': '9359aa74fb572740422836718cc91225dba16b95', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83634', 'name': 'v_b212f8a6-6328-4f58-a277-0330b0519b07', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] delete volume:v_b212f8a6-6328-4f58-a277-0330b0519b07 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c6785eea-69fe-4667-8854-9474483bfff0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_c6785eea-69fe-4667-8854-9474483bfff0 from snapshot s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b212f8a6-6328-4f58-a277-0330b0519b07 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] volume v_b212f8a6-6328-4f58-a277-0330b0519b07 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:05:15 user cinder-volume[73579]: DEBUG cinder.quota [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['bdc1943c-6e04-481b-9188-0ff2526776f4'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:15 user cinder-volume[73579]: WARNING cinder.quota [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1444976913 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1444976913, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:05:15 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=69,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:15 user cinder-volume[73579]: DEBUG cinder.quota [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Created reservations ['6ddd9731-b7b3-4411-98f6-e0d421c20c63', '72de23cf-fa9d-4c29-861b-af7df5ecf290', '09c78536-8ffb-4955-8827-0160e0261598', '7ec793c7-7feb-4e75-8fcf-8d4aa9c59121'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299@s_c6785eea-69fe-4667-8854-9474483bfff0', 'is_clone': True, 'full_name': 'Pool-0/s_c6785eea-69fe-4667-8854-9474483bfff0', 'name': 's_c6785eea-69fe-4667-8854-9474483bfff0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_c6785eea-69fe-4667-8854-9474483bfff0 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b4a3da2c-9229-49e8-9864-b2707a059cf2 tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293456896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:05:16 user cinder-volume[73579]: DEBUG cinder.manager [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:05:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c8ff9ce9-aecf-41b1-8673-17da335226fa tempest-GroupSnapshotsTest-1844706491 None] Delete group completed successfully. Apr 14 02:05:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot 99dea33f-263b-4f4d-a6ec-114ec6c020fa for volume 8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:05:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_8e30d5da-2923-47a9-9cb1-98605d191299 to s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:05:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:05:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_99dea33f-263b-4f4d-a6ec-114ec6c020fa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_99dea33f-263b-4f4d-a6ec-114ec6c020fa from snapshot s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] create snapshot 4fb682cc-012f-4147-abb3-0bc5272c850f for volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] cloning v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 to s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] create snapshot s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299@s_99dea33f-263b-4f4d-a6ec-114ec6c020fa', 'is_clone': True, 'full_name': 'Pool-0/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa', 'name': 's_99dea33f-263b-4f4d-a6ec-114ec6c020fa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_99dea33f-263b-4f4d-a6ec-114ec6c020fa properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=58,cinder:UPDATE=23,cinder:INSERT=19 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:19 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d4ae5a6e-aa8c-4ffa-a9c6-6d774ea77aa3 tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_4fb682cc-012f-4147-abb3-0bc5272c850f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] create volume s_4fb682cc-012f-4147-abb3-0bc5272c850f from snapshot s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2a8400cb-dfaf-469a-9494-70a3dacf01b6 tempest-GroupSnapshotsV319Test-834465644 None] Group tempest-GroupSnapshotsV319Test-Group-1190080963: creating Apr 14 02:05:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2a8400cb-dfaf-469a-9494-70a3dacf01b6 tempest-GroupSnapshotsV319Test-834465644 None] Group tempest-GroupSnapshotsV319Test-Group-1190080963: created successfully Apr 14 02:05:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2a8400cb-dfaf-469a-9494-70a3dacf01b6 tempest-GroupSnapshotsV319Test-834465644 None] Create group completed successfully. Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-e852f67a-498c-4d67-9652-9accfe888431-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-e852f67a-498c-4d67-9652-9accfe888431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_e852f67a-498c-4d67-9652-9accfe888431. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32@s_4fb682cc-012f-4147-abb3-0bc5272c850f', 'is_clone': True, 'full_name': 'Pool-0/s_4fb682cc-012f-4147-abb3-0bc5272c850f', 'name': 's_4fb682cc-012f-4147-abb3-0bc5272c850f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] volume s_4fb682cc-012f-4147-abb3-0bc5272c850f properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:05:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1f060b90-cea0-41ba-8a08-e68a876d9d56 tempest-TestStampPattern-190654074 None] Create snapshot completed successfully Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_e852f67a-498c-4d67-9652-9accfe888431 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299@s_e852f67a-498c-4d67-9652-9accfe888431', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e852f67a-498c-4d67-9652-9accfe888431', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439322', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111491', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4613614103199481715', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '409a4a3f59ef1092', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293338112', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84099', 'name': 's_e852f67a-498c-4d67-9652-9accfe888431', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_e852f67a-498c-4d67-9652-9accfe888431 of volume v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Flow 'volume_create_manager' (a55e8efc-440f-4b92-a58f-82810b3b0558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1dbfe5-aeda-48ef-b359-4e477afc981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1dbfe5-aeda-48ef-b359-4e477afc981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360062072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=995d82e4-e60d-46ff-a08b-e519cc2a8612,host='user@joviandss-2#joviandss-2',id=e8977d14-64c5-4826-8ca1-34382c046d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c28ba82ae94e0981a10aa68fe20440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:05:22Z,use_quota=True,user_id='0c33a158aa1747f7bcec38aab01ccfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197cdef2-d687-428f-a865-dbd67615e47e),volume_type_id=197cdef2-d687-428f-a865-dbd67615e47e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f8a010-136e-4902-a2a9-326d32ef1183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f8a010-136e-4902-a2a9-326d32ef1183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2280cafd-d301-4f87-82d8-f9271bc7075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2280cafd-d301-4f87-82d8-f9271bc7075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8977d14-64c5-4826-8ca1-34382c046d3a', 'volume_name': 'volume-e8977d14-64c5-4826-8ca1-34382c046d3a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e84a4-a731-48f0-91a3-b124b693ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e84a4-a731-48f0-91a3-b124b693ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f0b6b0-b881-468a-a1b7-b0c0fe124cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:21 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Volume e8977d14-64c5-4826-8ca1-34382c046d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8977d14-64c5-4826-8ca1-34382c046d3a', 'volume_size': 1} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] creating volume v_e8977d14-64c5-4826-8ca1-34382c046d3a. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] create volume {'name': 'v_e8977d14-64c5-4826-8ca1-34382c046d3a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e8977d14-64c5-4826-8ca1-34382c046d3a', 'is_clone': False, 'name': 'v_e8977d14-64c5-4826-8ca1-34382c046d3a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f0b6b0-b881-468a-a1b7-b0c0fe124cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8977d14-64c5-4826-8ca1-34382c046d3a', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078b444b-7ce8-49a2-981d-5157c4b69141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:22 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Volume volume-e8977d14-64c5-4826-8ca1-34382c046d3a (e8977d14-64c5-4826-8ca1-34382c046d3a): created successfully Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078b444b-7ce8-49a2-981d-5157c4b69141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Flow 'volume_create_manager' (a55e8efc-440f-4b92-a58f-82810b3b0558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c5d8900c-ca15-492e-adc5-3c4606724877 tempest-GroupSnapshotsV319Test-834465644 None] Created volume successfully. Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_e852f67a-498c-4d67-9652-9accfe888431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_e852f67a-498c-4d67-9652-9accfe888431 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.quota [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['d42afccc-fafd-4332-9cb7-aa813e72855f', '3dcf7746-5447-4349-874e-c8997a2f25fe', '3c9f8245-4594-4b89-a0e4-a828ae0de132', '6e326f86-46e8-489d-8f4c-58997c7595c4'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:22 user cinder-volume[73579]: INFO cinder.volume.manager [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:05:22 user cinder-volume[73579]: DEBUG cinder.coordination [None req-244551e5-ef6e-46db-82c9-4280b0d6c6df tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-e852f67a-498c-4d67-9652-9accfe888431-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-99dea33f-263b-4f4d-a6ec-114ec6c020fa-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-99dea33f-263b-4f4d-a6ec-114ec6c020fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_99dea33f-263b-4f4d-a6ec-114ec6c020fa. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:23 user cinder-volume[73579]: INFO cinder.volume.manager [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] GroupSnapshot 15fba5ad-bd4f-4c87-a2a9-7cabe5f437ed: creating. Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Group snapshot 15fba5ad-bd4f-4c87-a2a9-7cabe5f437ed: creating. {{(pid=73579) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] create snapshot 7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 for volume e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] cloning v_e8977d14-64c5-4826-8ca1-34382c046d3a to s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] create snapshot s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_99dea33f-263b-4f4d-a6ec-114ec6c020fa info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299@s_99dea33f-263b-4f4d-a6ec-114ec6c020fa', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439327', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111504', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15335095606703953753', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '77a7363d2647410e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293293056', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83649', 'name': 's_99dea33f-263b-4f4d-a6ec-114ec6c020fa', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_99dea33f-263b-4f4d-a6ec-114ec6c020fa of volume v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] create volume s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 from snapshot s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_99dea33f-263b-4f4d-a6ec-114ec6c020fa {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_99dea33f-263b-4f4d-a6ec-114ec6c020fa deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e8977d14-64c5-4826-8ca1-34382c046d3a@s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89', 'is_clone': True, 'full_name': 'Pool-0/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89', 'name': 's_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.quota [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['cf36c7e3-4051-4256-afd8-5a8a76e38e7a', '25764f76-21ed-49cb-8ded-d0ff171d1a97', 'b0b07433-cc7d-49f2-b26c-ca66e134a5fc', '24af10d2-d361-4e7c-8544-0cdb8fcaf83f'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] volume s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=51,cinder:UPDATE=25,cinder:INSERT=22,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6571ad4e-2eb8-4cc6-8825-4024495dbd19 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-99dea33f-263b-4f4d-a6ec-114ec6c020fa-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:05:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-28623d67-035b-4afa-97e7-e5cf28ec6462 tempest-GroupSnapshotsV319Test-834465644 None] group_snapshot 15fba5ad-bd4f-4c87-a2a9-7cabe5f437ed: created successfully Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-c6785eea-69fe-4667-8854-9474483bfff0-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-c6785eea-69fe-4667-8854-9474483bfff0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_c6785eea-69fe-4667-8854-9474483bfff0. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Flow 'volume_create_manager' (a15f9902-8624-4eae-99f2-e4824c3f4e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1a23a1-a531-4c0b-949b-e20e8ed59103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] group_snapshot 15fba5ad-bd4f-4c87-a2a9-7cabe5f437ed: deleting Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1a23a1-a531-4c0b-949b-e20e8ed59103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2125583498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4c538a4c-d102-445d-bfef-2cb750d83cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27dc405e16434633956ed2cd7e1791cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4fb682cc-012f-4147-abb3-0bc5272c850f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:05:27Z,use_quota=True,user_id='7ae5170969344b9fa5294231f8ffbe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda58168-3376-4884-92ba-f93fdb33cff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda58168-3376-4884-92ba-f93fdb33cff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85735222-d818-40c6-9a5c-844327e6ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85735222-d818-40c6-9a5c-844327e6ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c538a4c-d102-445d-bfef-2cb750d83cb9', 'volume_name': 'volume-4c538a4c-d102-445d-bfef-2cb750d83cb9', 'volume_size': 1, 'snapshot_id': '4fb682cc-012f-4147-abb3-0bc5272c850f'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4571bab-694a-434c-b90b-7f053bc2d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4571bab-694a-434c-b90b-7f053bc2d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905aee49-0499-44e9-b640-c9616ed699eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:27 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Volume 4c538a4c-d102-445d-bfef-2cb750d83cb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c538a4c-d102-445d-bfef-2cb750d83cb9', 'volume_size': 1, 'snapshot_id': '4fb682cc-012f-4147-abb3-0bc5272c850f'} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] create volume 4c538a4c-d102-445d-bfef-2cb750d83cb9 from snapshot 4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] cloning s_4fb682cc-012f-4147-abb3-0bc5272c850f to v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] create snapshot v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] group_snapshot 15fba5ad-bd4f-4c87-a2a9-7cabe5f437ed: deleting {{(pid=73579) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] deleating snapshot s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] get snapshots for volume s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_c6785eea-69fe-4667-8854-9474483bfff0 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299@s_c6785eea-69fe-4667-8854-9474483bfff0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c6785eea-69fe-4667-8854-9474483bfff0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439324', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111498', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11348495269832362458', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2bcaa700f4478cc3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293305344', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82128', 'name': 's_c6785eea-69fe-4667-8854-9474483bfff0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_c6785eea-69fe-4667-8854-9474483bfff0 of volume v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] get volume s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e8977d14-64c5-4826-8ca1-34382c046d3a@s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439334', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111523', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13309541422893319310', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0ac42fd4e0c79b06', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293293056', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83113', 'name': 's_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] delete snapshot s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 of volume v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_4c538a4c-d102-445d-bfef-2cb750d83cb9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] create volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 from snapshot v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots/s_c6785eea-69fe-4667-8854-9474483bfff0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_c6785eea-69fe-4667-8854-9474483bfff0 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.quota [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['5fd4d884-ec3d-4ad3-a92b-a5ce7e6e2cb9', 'b1f862a8-bc1c-4396-89e5-fa5907195daf', 'c4da9f70-5797-44c2-b878-e8ebaa33d450', 'f599377e-b405-44b7-8d5b-e336ed3846b9'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:29 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0fef5a76-5090-4a93-9565-660e3b82ce18 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-c6785eea-69fe-4667-8854-9474483bfff0-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_4fb682cc-012f-4147-abb3-0bc5272c850f@v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'is_clone': True, 'full_name': 'Pool-0/v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'name': 'v_4c538a4c-d102-445d-bfef-2cb750d83cb9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] get volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots/s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] snapshot s_7dbfca49-a2cb-4ce9-bb0b-d6fb47886f89 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:05:29 user cinder-volume[73579]: WARNING cinder.quota [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-122108730 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-122108730, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:05:29 user cinder-volume[73579]: WARNING cinder.quota [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-122108730 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-122108730, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_4fb682cc-012f-4147-abb3-0bc5272c850f@v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439338', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '111534', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6055527989012336435', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'da5177e431041d7f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293293056', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83660', 'name': 'v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.quota [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] Created reservations ['fa35e6ed-c372-417f-ae72-5eec64f4552b', 'fca7b425-e43e-480c-af88-f08757e241f1', 'f01d20b7-1dba-448c-9be3-78be4ffe71c2', '1b4532be-138c-476e-9799-bf4325df068e'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=63,cinder:DELETE=2,cinder:UPDATE=29,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905aee49-0499-44e9-b640-c9616ed699eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c538a4c-d102-445d-bfef-2cb750d83cb9', 'volume_size': 1, 'snapshot_id': '4fb682cc-012f-4147-abb3-0bc5272c850f'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733d3e67-2c6e-4663-9042-4ed534ff4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Volume volume-4c538a4c-d102-445d-bfef-2cb750d83cb9 (4c538a4c-d102-445d-bfef-2cb750d83cb9): created successfully Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733d3e67-2c6e-4663-9042-4ed534ff4c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Flow 'volume_create_manager' (a15f9902-8624-4eae-99f2-e4824c3f4e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:29 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6459fa23-a29f-4e4c-8cf7-6a658b0dcb29 tempest-TestStampPattern-190654074 None] Created volume successfully. Apr 14 02:05:29 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b0c39b11-f400-43a7-b204-382d261c1771 tempest-GroupSnapshotsV319Test-834465644 None] group_snapshot 15fba5ad-bd4f-4c87-a2a9-7cabe5f437ed: deleted successfully Apr 14 02:05:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:05:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:05:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:05:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] remove_export for volume: e8977d14-64c5-4826-8ca1-34382c046d3a. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360062072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=995d82e4-e60d-46ff-a08b-e519cc2a8612,host='user@joviandss-2#joviandss-2',id=e8977d14-64c5-4826-8ca1-34382c046d3a,launched_at=2023-04-14T02:05:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c28ba82ae94e0981a10aa68fe20440',provider_auth='CHAP gLhRrlOf ocQVIMLrdn1F9B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:22Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T02:05:31Z,use_quota=True,user_id='0c33a158aa1747f7bcec38aab01ccfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197cdef2-d687-428f-a865-dbd67615e47e),volume_type_id=197cdef2-d687-428f-a865-dbd67615e47e) from target:iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] detach volume v_e8977d14-64c5-4826-8ca1-34382c046d3a from target iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a/luns/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a/luns/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a/luns/v_e8977d14-64c5-4826-8ca1-34382c046d3a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a/luns/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] failed to remove resource iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a because of JDSS resource v_e8977d14-64c5-4826-8ca1-34382c046d3a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] delete target: iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] delete target iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] failed to remove resource iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a because of JDSS resource iqn.2010-10.org.openstack:e8977d14-64c5-4826-8ca1-34382c046d3a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] deleating volume v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] get snapshots for volume v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] terminate connection for 8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:05:31 user cinder-volume[73579]: INFO cinder.volume.manager [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Terminate volume connection completed successfully. Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Deleting attachment cf83d7bc-4cd0-4862-96b5-4861b127ce25. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 8e30d5da-2923-47a9-9cb1-98605d191299. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145429467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e30d5da-2923-47a9-9cb1-98605d191299,launched_at=2023-04-14T02:03:13Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP DXYiqSgT YXalWvoQO0dpxr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:10Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:05:30Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_8e30d5da-2923-47a9-9cb1-98605d191299 from target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293280768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] get volume v_e8977d14-64c5-4826-8ca1-34382c046d3a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e8977d14-64c5-4826-8ca1-34382c046d3a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439331', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111515', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6374169868538128032', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1559aa3e2c5101f8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293280768', 'san:volume_id': '1559aa3e2c5101f89e93ef1fb905c6672f9aa8fa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83891', 'name': 'v_e8977d14-64c5-4826-8ca1-34382c046d3a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] delete volume:v_e8977d14-64c5-4826-8ca1-34382c046d3a recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 req-5b1476f4-0de1-42ca-b604-7ec0047024e4 tempest-VolumesSnapshotTestJSON-2121749885 None] target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:05:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e8977d14-64c5-4826-8ca1-34382c046d3a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] volume v_e8977d14-64c5-4826-8ca1-34382c046d3a deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:05:33 user cinder-volume[73579]: DEBUG cinder.quota [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Created reservations ['211edd79-957f-49f2-819d-8baf8d3dc191'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:33 user cinder-volume[73579]: WARNING cinder.quota [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-122108730 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-122108730, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:05:33 user cinder-volume[73579]: DEBUG cinder.quota [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Created reservations ['dcd42bbc-4b26-42af-9131-b0409bc6e70b', 'e02717f5-124d-46ce-aad8-cf1e1045ee93', 'a2b44bb4-84a5-4c52-8662-e65a84157e31', '61e85bdc-acb9-4617-9763-39c190e5ac33'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:05:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:05:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293362688', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:05:34 user cinder-volume[73579]: DEBUG cinder.manager [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:05:34 user cinder-volume[73579]: INFO cinder.volume.manager [None req-70ecd205-6cf5-4b5a-b878-bbe77f9b2dce tempest-GroupSnapshotsV319Test-834465644 None] Delete group completed successfully. Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Flow 'volume_create_manager' (2a15e7a9-9d2c-4408-96cf-8d409384119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011787df-d8b9-4cf2-a0f2-9e28c791dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011787df-d8b9-4cf2-a0f2-9e28c791dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1906861950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c9fe807a-cede-454b-a316-b65409ca3fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5909bfcd3bc1475c93dc0b098d89e9b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:05:39Z,use_quota=True,user_id='0bf0ac5289df4feebc53fa12942380df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19609aa3-52ba-409a-9419-a4c4ace881cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19609aa3-52ba-409a-9419-a4c4ace881cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd96e34-05ed-4dda-af7d-c0a45e311644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd96e34-05ed-4dda-af7d-c0a45e311644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9fe807a-cede-454b-a316-b65409ca3fdd', 'volume_name': 'volume-c9fe807a-cede-454b-a316-b65409ca3fdd', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ace223-fcad-4722-8562-265917748a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ace223-fcad-4722-8562-265917748a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2e0508-2064-44a1-ae09-ddf99fb59102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:39 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Volume c9fe807a-cede-454b-a316-b65409ca3fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9fe807a-cede-454b-a316-b65409ca3fdd', 'volume_size': 1} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] creating volume v_c9fe807a-cede-454b-a316-b65409ca3fdd. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] create volume {'name': 'v_c9fe807a-cede-454b-a316-b65409ca3fdd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c9fe807a-cede-454b-a316-b65409ca3fdd', 'is_clone': False, 'name': 'v_c9fe807a-cede-454b-a316-b65409ca3fdd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2e0508-2064-44a1-ae09-ddf99fb59102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9fe807a-cede-454b-a316-b65409ca3fdd', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627d4ba1-1e78-4522-98ca-a08fb7f6a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:05:40 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Volume volume-c9fe807a-cede-454b-a316-b65409ca3fdd (c9fe807a-cede-454b-a316-b65409ca3fdd): created successfully Apr 14 02:05:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627d4ba1-1e78-4522-98ca-a08fb7f6a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:05:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Flow 'volume_create_manager' (2a15e7a9-9d2c-4408-96cf-8d409384119b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:05:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-88412742-afd7-46be-9e83-2fdbb995460f tempest-VolumesServicesTestJSON-56624557 None] Created volume successfully. Apr 14 02:05:40 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Acquiring lock "cinder-c9fe807a-cede-454b-a316-b65409ca3fdd-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Lock "cinder-c9fe807a-cede-454b-a316-b65409ca3fdd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] remove_export for volume: c9fe807a-cede-454b-a316-b65409ca3fdd. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1906861950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c9fe807a-cede-454b-a316-b65409ca3fdd,launched_at=2023-04-14T02:05:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5909bfcd3bc1475c93dc0b098d89e9b3',provider_auth='CHAP SAOrBFNM sSYMIgDybPFQad',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:39Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:05:41Z,updated_at=2023-04-14T02:05:41Z,use_quota=True,user_id='0bf0ac5289df4feebc53fa12942380df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] detach volume v_c9fe807a-cede-454b-a316-b65409ca3fdd from target iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd/luns/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd/luns/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd/luns/v_c9fe807a-cede-454b-a316-b65409ca3fdd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd/luns/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] failed to remove resource iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd because of JDSS resource v_c9fe807a-cede-454b-a316-b65409ca3fdd DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] delete target: iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] delete target iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] failed to remove resource iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd because of JDSS resource iqn.2010-10.org.openstack:c9fe807a-cede-454b-a316-b65409ca3fdd DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] deleating volume v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] get snapshots for volume v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] get volume v_c9fe807a-cede-454b-a316-b65409ca3fdd info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c9fe807a-cede-454b-a316-b65409ca3fdd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439348', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111544', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6775513251460926003', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '83a22aaef31acbe4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293280768', 'san:volume_id': '83a22aaef31acbe403f75411f77830c46e892e60', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83903', 'name': 'v_c9fe807a-cede-454b-a316-b65409ca3fdd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] delete volume:v_c9fe807a-cede-454b-a316-b65409ca3fdd recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c9fe807a-cede-454b-a316-b65409ca3fdd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] volume v_c9fe807a-cede-454b-a316-b65409ca3fdd deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:05:43 user cinder-volume[73579]: DEBUG cinder.quota [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Created reservations ['bd686e6b-9839-474a-a819-8869babb06c4', '6b1c102b-0a20-44d6-b204-a608b41016a2', 'df236323-5f98-431c-a5bd-aebcbcda472e', '057b2e05-a538-4619-9d92-afef2e19da43'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:05:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:05:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:05:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:05:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:05:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293350400', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:05:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:05:44 user cinder-volume[73579]: DEBUG cinder.manager [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:05:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Deleted volume successfully. Apr 14 02:05:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c0a2b0bc-ed39-44a3-96d7-7d8655c3014f tempest-VolumesServicesTestJSON-56624557 None] Lock "cinder-c9fe807a-cede-454b-a316-b65409ca3fdd-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:05:54 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=47,cinder:UPDATE=30,cinder:INSERT=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-8e30d5da-2923-47a9-9cb1-98605d191299-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-8e30d5da-2923-47a9-9cb1-98605d191299-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 8e30d5da-2923-47a9-9cb1-98605d191299. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145429467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e30d5da-2923-47a9-9cb1-98605d191299,launched_at=2023-04-14T02:03:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP DXYiqSgT YXalWvoQO0dpxr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:10Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:06:21Z,updated_at=2023-04-14T02:06:21Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_8e30d5da-2923-47a9-9cb1-98605d191299 from target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns/v_8e30d5da-2923-47a9-9cb1-98605d191299'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299/luns/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 because of JDSS resource v_8e30d5da-2923-47a9-9cb1-98605d191299 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 because of JDSS resource iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating volume v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_8e30d5da-2923-47a9-9cb1-98605d191299 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_8e30d5da-2923-47a9-9cb1-98605d191299', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8e30d5da-2923-47a9-9cb1-98605d191299', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439201', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '111346', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1222166920597254311', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '63441e22069ecf8c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293362688', 'san:volume_id': '63441e22069ecf8c95589c210da9422faad14410', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83721', 'name': 'v_8e30d5da-2923-47a9-9cb1-98605d191299', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot v_8e30d5da-2923-47a9-9cb1-98605d191299 of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_8e30d5da-2923-47a9-9cb1-98605d191299 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot v_8e30d5da-2923-47a9-9cb1-98605d191299 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.quota [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['4689f326-73a2-4a79-b06a-86e7c0da087a', '8d653c05-53bf-484a-8589-ffc9785a1c6d', 'a46b0ba0-8855-4127-ab59-be7fe6b78409', '9c0d3233-b3c1-49de-b830-07dcaa1fd62c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293399552', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.manager [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:06:23 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Deleted volume successfully. Apr 14 02:06:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0c37e66e-f65a-4d73-ad10-43699a0fd3b6 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-8e30d5da-2923-47a9-9cb1-98605d191299-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:06:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot 7e70bc76-6bcc-4570-8c4e-a25f1815a39a for volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:06:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 to s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:06:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:06:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_7e70bc76-6bcc-4570-8c4e-a25f1815a39a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a from snapshot s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:06:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a', 'is_clone': True, 'full_name': 'Pool-0/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a', 'name': 's_7e70bc76-6bcc-4570-8c4e-a25f1815a39a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4,cinder:INSERT=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:06:26 user cinder-volume[73579]: INFO cinder.volume.manager [None req-dad6b751-b5fc-411b-b3a7-1cf1ca754a5d tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-7e70bc76-6bcc-4570-8c4e-a25f1815a39a-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-7e70bc76-6bcc-4570-8c4e-a25f1815a39a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439394', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111561', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6980583984691885514', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7b990f167295caf6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293362688', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82149', 'name': 's_7e70bc76-6bcc-4570-8c4e-a25f1815a39a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a of volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:06:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_7e70bc76-6bcc-4570-8c4e-a25f1815a39a deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:06:29 user cinder-volume[73579]: DEBUG cinder.quota [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['f782c1c4-0341-4c7a-be09-6c496b0cb87c', 'd1e2fe17-e752-4a84-813c-85309b1c473b', '5efe8fd7-e454-455b-8a38-07fcdfddfc68', 'e9ed3524-02c3-433b-bbf4-97df57157d9a'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:06:29 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:06:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1eee8e27-2dc7-491e-9e03-6613648bb57d tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-7e70bc76-6bcc-4570-8c4e-a25f1815a39a-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot 7d988194-331e-432e-ad10-edbfb898558b for volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 to s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293374976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:06:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:06:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_7d988194-331e-432e-ad10-edbfb898558b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_7d988194-331e-432e-ad10-edbfb898558b from snapshot s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:06:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_7d988194-331e-432e-ad10-edbfb898558b', 'is_clone': True, 'full_name': 'Pool-0/s_7d988194-331e-432e-ad10-edbfb898558b', 'name': 's_7d988194-331e-432e-ad10-edbfb898558b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:06:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:06:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:06:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_7d988194-331e-432e-ad10-edbfb898558b properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:06:32 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b40b4b5f-696e-48d9-84b9-5b81dbfca4f5 tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:06:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=36,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=20,cinder:DELETE=1,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] create export for volume: 4c538a4c-d102-445d-bfef-2cb750d83cb9. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] ensure volume 4c538a4c-d102-445d-bfef-2cb750d83cb9 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] check if targe iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] create target and attach volume 4c538a4c-d102-445d-bfef-2cb750d83cb9 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] create target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] atach volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 to target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:07:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6461353137376534', 'lun': 0, 'mode': 'wt', 'name': 'v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'prod_id': 'Storage', 'scsi_id': 'da5177e431041d7f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] add credentails to target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:07:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Geting {'code': 201, 'error': None, 'data': {'name': 'alqbUyWc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] initialize_connection for 4c538a4c-d102-445d-bfef-2cb750d83cb9 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:07:28 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alqbUyWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a929b529-cdbd-4be1-b921-dd79c1e4abd9'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:07:28 user cinder-volume[73579]: INFO cinder.volume.manager [req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 req-da2c8e51-d23b-4651-9cd4-b24bb066d159 tempest-TestStampPattern-190654074 None] attachment_update completed successfully. Apr 14 02:07:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:07:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:07:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:07:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114293346304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:07:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] terminate connection for 4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:07:33 user cinder-volume[73579]: INFO cinder.volume.manager [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Terminate volume connection completed successfully. Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Deleting attachment a929b529-cdbd-4be1-b921-dd79c1e4abd9. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] remove_export for volume: 4c538a4c-d102-445d-bfef-2cb750d83cb9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2125583498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4c538a4c-d102-445d-bfef-2cb750d83cb9,launched_at=2023-04-14T02:05:30Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='27dc405e16434633956ed2cd7e1791cd',provider_auth='CHAP alqbUyWc 1GOaAWvKYMqPZe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:27Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=4fb682cc-012f-4147-abb3-0bc5272c850f,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:07:32Z,use_quota=True,user_id='7ae5170969344b9fa5294231f8ffbe72',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] detach volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 from target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] delete target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] delete target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-340378ae-6cdf-4796-8250-446676e867ce req-a25728a7-4314-4c5e-b535-d9342e46df44 tempest-TestStampPattern-190654074 None] target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:07:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (1d81123c-a405-4551-b771-fb5bc34c99f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fda7ab9-a219-46bb-b0fc-66f419557f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fda7ab9-a219-46bb-b0fc-66f419557f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031135748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=be22dc68-83db-4522-a7b6-50815a09c1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:07:42Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164814b3-f50d-491a-928c-5ecc37b00e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164814b3-f50d-491a-928c-5ecc37b00e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dd192a-1d8a-4e29-bd35-84989603b7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dd192a-1d8a-4e29-bd35-84989603b7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be22dc68-83db-4522-a7b6-50815a09c1de', 'volume_name': 'volume-be22dc68-83db-4522-a7b6-50815a09c1de', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15743654-5386-426e-a2ad-285dd2314b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15743654-5386-426e-a2ad-285dd2314b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a06ea5-9fc7-4ae1-870e-a3a289e9eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:07:41 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Volume be22dc68-83db-4522-a7b6-50815a09c1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be22dc68-83db-4522-a7b6-50815a09c1de', 'volume_size': 1} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] creating volume v_be22dc68-83db-4522-a7b6-50815a09c1de. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] create volume {'name': 'v_be22dc68-83db-4522-a7b6-50815a09c1de', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_be22dc68-83db-4522-a7b6-50815a09c1de', 'is_clone': False, 'name': 'v_be22dc68-83db-4522-a7b6-50815a09c1de'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a06ea5-9fc7-4ae1-870e-a3a289e9eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be22dc68-83db-4522-a7b6-50815a09c1de', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:07:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1c75d0-3e75-439f-967a-0ef1b0634f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:07:42 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Volume volume-be22dc68-83db-4522-a7b6-50815a09c1de (be22dc68-83db-4522-a7b6-50815a09c1de): created successfully Apr 14 02:07:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1c75d0-3e75-439f-967a-0ef1b0634f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:07:42 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (1d81123c-a405-4551-b771-fb5bc34c99f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:07:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c28da3fa-2263-4845-8510-7ce7773409d4 tempest-VolumesActionsTest-1128976857 None] Created volume successfully. Apr 14 02:07:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a5cc6828-68a8-4344-83fa-b1b9062ce548 tempest-VolumesActionsTest-1128976857 None] Acquiring lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de" by "attach_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:07:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a5cc6828-68a8-4344-83fa-b1b9062ce548 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de" acquired by "attach_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:07:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a5cc6828-68a8-4344-83fa-b1b9062ce548 tempest-VolumesActionsTest-1128976857 None] Attaching volume be22dc68-83db-4522-a7b6-50815a09c1de to instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 at mountpoint /dev/vdb on host None. Apr 14 02:07:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-a5cc6828-68a8-4344-83fa-b1b9062ce548 tempest-VolumesActionsTest-1128976857 None] Attach volume completed successfully. Apr 14 02:07:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-a5cc6828-68a8-4344-83fa-b1b9062ce548 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de" released by "attach_volume" :: held 0.056s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] terminate connection for be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:07:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Terminate volume connection completed successfully. Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Acquiring lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-detach_volume" by "detach_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:07:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Detaching volume be22dc68-83db-4522-a7b6-50815a09c1de from instance bd1bf0f2-5c22-4c42-9e19-b22343997d21. Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] remove_export for volume: be22dc68-83db-4522-a7b6-50815a09c1de. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] detach volume:Volume(_name_id=None,admin_metadata={attached_mode='rw',readonly='False'},attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031135748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=be22dc68-83db-4522-a7b6-50815a09c1de,launched_at=2023-04-14T02:07:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth='CHAP KxCJajBD St6f2XdlqhYGxI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:07:42Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='error',terminated_at=None,updated_at=2023-04-14T02:07:44Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] detach volume v_be22dc68-83db-4522-a7b6-50815a09c1de from target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de because of JDSS resource v_be22dc68-83db-4522-a7b6-50815a09c1de DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] delete target: iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] delete target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de because of JDSS resource iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:07:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Detach volume completed successfully. Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-54626044-5aca-4f2e-87a9-ab39d8007fd5 tempest-VolumesActionsTest-370832694 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-89e394e8-fb63-4db3-b1b1-570a39d40860 tempest-VolumesActionsTest-1128976857 None] Acquiring lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-detach_volume" by "detach_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-89e394e8-fb63-4db3-b1b1-570a39d40860 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:07:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-89e394e8-fb63-4db3-b1b1-570a39d40860 tempest-VolumesActionsTest-1128976857 None] Volume detach called, but volume not attached. Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-89e394e8-fb63-4db3-b1b1-570a39d40860 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Acquiring lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] remove_export for volume: be22dc68-83db-4522-a7b6-50815a09c1de. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031135748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=be22dc68-83db-4522-a7b6-50815a09c1de,launched_at=2023-04-14T02:07:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth='CHAP KxCJajBD St6f2XdlqhYGxI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:07:42Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:07:45Z,updated_at=2023-04-14T02:07:45Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] detach volume v_be22dc68-83db-4522-a7b6-50815a09c1de from target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de/luns/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] failed to remove resource iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de because of JDSS resource v_be22dc68-83db-4522-a7b6-50815a09c1de DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] delete target: iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] delete target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] failed to remove resource iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de because of JDSS resource iqn.2010-10.org.openstack:be22dc68-83db-4522-a7b6-50815a09c1de DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] deleating volume v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] get snapshots for volume v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] get volume v_be22dc68-83db-4522-a7b6-50815a09c1de info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_be22dc68-83db-4522-a7b6-50815a09c1de', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439471', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111595', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4429108059587650779', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '68b7d08a0f2a59c9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293137408', 'san:volume_id': '68b7d08a0f2a59c959469bf794fe4d6529ecfdaa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83531', 'name': 'v_be22dc68-83db-4522-a7b6-50815a09c1de', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] delete volume:v_be22dc68-83db-4522-a7b6-50815a09c1de recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_be22dc68-83db-4522-a7b6-50815a09c1de {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] volume v_be22dc68-83db-4522-a7b6-50815a09c1de deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.quota [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Created reservations ['41576841-fb02-457e-8b93-3e4f2c043026', '0e61ccda-ac22-4d8b-9609-c32fdea3fa2e', 'fa3d527f-f079-4d3f-9929-3d2b3fd5bb2e', 'ede3be6b-ad00-43cb-9a49-d67603ca0743'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 200, 'error': None, 'data': {'available': '114293219328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.manager [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:07:47 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Deleted volume successfully. Apr 14 02:07:47 user cinder-volume[73579]: DEBUG cinder.coordination [None req-3be8c043-e3d9-4216-96e2-aff8e4cf74a2 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-be22dc68-83db-4522-a7b6-50815a09c1de-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:07:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=52,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=36,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] terminate connection for 06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:08:20 user cinder-volume[73579]: INFO cinder.volume.manager [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Terminate volume connection completed successfully. Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Deleting attachment 16d86764-c060-45f1-9c4a-8cc75f65ca31. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: 06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1113854014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=06b73a5e-5178-4561-af91-11e1028d2238,launched_at=2023-04-14T02:01:43Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP HBVCXlJa 0BFXnkh3IfemQv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:40Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T02:03:51Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] detach volume v_06b73a5e-5178-4561-af91-11e1028d2238 from target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-0b01e6e5-8859-449b-8a7b-19d855fa0ed4 tempest-ServerActionsTestJSON-2035821517 None] target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.coordination [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Acquiring lock "cinder-06b73a5e-5178-4561-af91-11e1028d2238-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.coordination [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-06b73a5e-5178-4561-af91-11e1028d2238-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: 06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1113854014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=06b73a5e-5178-4561-af91-11e1028d2238,launched_at=2023-04-14T02:01:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP HBVCXlJa 0BFXnkh3IfemQv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:01:40Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:08:22Z,updated_at=2023-04-14T02:08:22Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] detach volume v_06b73a5e-5178-4561-af91-11e1028d2238 from target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238/luns/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] failed to remove resource iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 because of JDSS resource v_06b73a5e-5178-4561-af91-11e1028d2238 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] failed to remove resource iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 because of JDSS resource iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] deleating volume v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] get snapshots for volume v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] get volume v_06b73a5e-5178-4561-af91-11e1028d2238 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4@v_06b73a5e-5178-4561-af91-11e1028d2238', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_06b73a5e-5178-4561-af91-11e1028d2238', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439111', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26112000', 'sharesmb': None, 'createtxg': '111246', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '561453614735302866', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10133504', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '4f0ba6fcc48ee1f6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114293219328', 'san:volume_id': '4f0ba6fcc48ee1f6db9dd0c8a5c5a7b59d35d087', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10133504', 'objsetid': '81393', 'name': 'v_06b73a5e-5178-4561-af91-11e1028d2238', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10133504', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] delete snapshot v_06b73a5e-5178-4561-af91-11e1028d2238 of volume v_ccaaa5cb-e964-406f-baca-e7660e8ceff4 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ccaaa5cb-e964-406f-baca-e7660e8ceff4/snapshots/v_06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] snapshot v_06b73a5e-5178-4561-af91-11e1028d2238 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:08:23 user cinder-volume[73579]: DEBUG cinder.quota [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Created reservations ['f9e97c55-0906-4d9e-9972-5236ac6977b3', 'b4fc6f5a-8398-4a69-9e16-399dfc4c9d59', '799fce83-077a-4d70-bf2b-7f695864e76a', 'ecafb09e-51cc-4020-94b6-475ef184fc76'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:08:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:08:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:08:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303401984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:08:24 user cinder-volume[73579]: DEBUG cinder.manager [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:08:24 user cinder-volume[73579]: INFO cinder.volume.manager [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Deleted volume successfully. Apr 14 02:08:24 user cinder-volume[73579]: DEBUG cinder.coordination [req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 req-fe2bcd8e-34ca-4a77-a008-af05286867ce tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-06b73a5e-5178-4561-af91-11e1028d2238-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] create export for volume: 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] ensure volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] check if targe iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] create target and attach volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] create target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] atach volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 to target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:08:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3430303862323336', 'lun': 0, 'mode': 'wt', 'name': 'v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'prod_id': 'Storage', 'scsi_id': '4008b23660890311'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] add credentails to target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:08:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'name': 'kQWcapHS'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] initialize_connection for 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:08:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQWcapHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3fad3d3a-fc9e-49ba-adad-dba96b56b680'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:08:29 user cinder-volume[73579]: INFO cinder.volume.manager [req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 req-92fcc97b-2da0-4bac-acc6-97de63fab2ad tempest-VolumesSnapshotTestJSON-2121749885 None] attachment_update completed successfully. Apr 14 02:08:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:08:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:08:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:08:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303414272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:08:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:08:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot c75e94b6-85e3-43f3-b703-33fbdeab45cd for volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:08:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 to s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:08:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:08:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c75e94b6-85e3-43f3-b703-33fbdeab45cd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_c75e94b6-85e3-43f3-b703-33fbdeab45cd from snapshot s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:08:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_c75e94b6-85e3-43f3-b703-33fbdeab45cd', 'is_clone': True, 'full_name': 'Pool-0/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd', 'name': 's_c75e94b6-85e3-43f3-b703-33fbdeab45cd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_c75e94b6-85e3-43f3-b703-33fbdeab45cd properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:08:34 user cinder-volume[73579]: INFO cinder.volume.manager [None req-07722d07-eaf5-4970-857f-45c4c1e85c6d tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:08:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot e9c3f572-4a4b-4ee7-a225-396489723eda for volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:08:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 to s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:08:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:08:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e9c3f572-4a4b-4ee7-a225-396489723eda'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_e9c3f572-4a4b-4ee7-a225-396489723eda from snapshot s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:08:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_e9c3f572-4a4b-4ee7-a225-396489723eda', 'is_clone': True, 'full_name': 'Pool-0/s_e9c3f572-4a4b-4ee7-a225-396489723eda', 'name': 's_e9c3f572-4a4b-4ee7-a225-396489723eda'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_e9c3f572-4a4b-4ee7-a225-396489723eda properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:08:37 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f3f758dd-c294-4a6a-8e06-076c02246575 tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:08:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-e9c3f572-4a4b-4ee7-a225-396489723eda-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:38 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-e9c3f572-4a4b-4ee7-a225-396489723eda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_e9c3f572-4a4b-4ee7-a225-396489723eda. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:08:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (a1a2bbd4-d30f-458f-a223-b77daca31157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5271d7-693f-447a-8b6d-c7c01145859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5271d7-693f-447a-8b6d-c7c01145859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-747581057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0beb75bd-25c5-4a17-9a40-af916f44f16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:08:39Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7accbdc-c755-45bc-b771-2538c8fd398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7accbdc-c755-45bc-b771-2538c8fd398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3af382-833f-4e66-8e8b-3bef536a7538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3af382-833f-4e66-8e8b-3bef536a7538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0beb75bd-25c5-4a17-9a40-af916f44f16f', 'volume_name': 'volume-0beb75bd-25c5-4a17-9a40-af916f44f16f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf0d38c-0214-40e2-9381-f12830a44df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf0d38c-0214-40e2-9381-f12830a44df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e0c249-c18f-41e8-8db7-89cf7d60ac9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:39 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Volume 0beb75bd-25c5-4a17-9a40-af916f44f16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0beb75bd-25c5-4a17-9a40-af916f44f16f', 'volume_size': 1} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] creating volume v_0beb75bd-25c5-4a17-9a40-af916f44f16f. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] create volume {'name': 'v_0beb75bd-25c5-4a17-9a40-af916f44f16f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_e9c3f572-4a4b-4ee7-a225-396489723eda info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_e9c3f572-4a4b-4ee7-a225-396489723eda', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e9c3f572-4a4b-4ee7-a225-396489723eda', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439526', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111625', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8433374754523938491', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '54632b9065d5f285', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303377408', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82636', 'name': 's_e9c3f572-4a4b-4ee7-a225-396489723eda', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_e9c3f572-4a4b-4ee7-a225-396489723eda of volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0beb75bd-25c5-4a17-9a40-af916f44f16f', 'is_clone': False, 'name': 'v_0beb75bd-25c5-4a17-9a40-af916f44f16f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e0c249-c18f-41e8-8db7-89cf7d60ac9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0beb75bd-25c5-4a17-9a40-af916f44f16f', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f78c58-e3b9-406a-ba27-911877ff078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:40 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Volume volume-0beb75bd-25c5-4a17-9a40-af916f44f16f (0beb75bd-25c5-4a17-9a40-af916f44f16f): created successfully Apr 14 02:08:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f78c58-e3b9-406a-ba27-911877ff078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (a1a2bbd4-d30f-458f-a223-b77daca31157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-afe26ca5-7ba9-4c38-937d-2fbb3143cbf6 tempest-VolumesActionsTest-1128976857 None] Created volume successfully. Apr 14 02:08:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_e9c3f572-4a4b-4ee7-a225-396489723eda {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_e9c3f572-4a4b-4ee7-a225-396489723eda deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.quota [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['a56e2a66-d9a3-48b8-b37f-78bf016d0d75', '608eb93b-16cd-47eb-b1ee-de6a1bc3a5a8', 'f3a0eda9-a79d-44da-ad34-408fef0670f7', '204e27e3-7837-4af1-a91c-574c07ebd9b6'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:08:41 user cinder-volume[73579]: INFO cinder.volume.manager [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87e39721-a966-4467-9830-5358b2740118 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-e9c3f572-4a4b-4ee7-a225-396489723eda-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Acquiring lock "cinder-0beb75bd-25c5-4a17-9a40-af916f44f16f-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Lock "cinder-0beb75bd-25c5-4a17-9a40-af916f44f16f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] remove_export for volume: 0beb75bd-25c5-4a17-9a40-af916f44f16f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-747581057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0beb75bd-25c5-4a17-9a40-af916f44f16f,launched_at=2023-04-14T02:08:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth='CHAP DuJnZSwa 4K0wWr95UINjVF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:39Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:08:41Z,updated_at=2023-04-14T02:08:41Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] detach volume v_0beb75bd-25c5-4a17-9a40-af916f44f16f from target iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f/luns/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f/luns/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f/luns/v_0beb75bd-25c5-4a17-9a40-af916f44f16f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f/luns/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f because of JDSS resource v_0beb75bd-25c5-4a17-9a40-af916f44f16f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] delete target: iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] delete target iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f because of JDSS resource iqn.2010-10.org.openstack:0beb75bd-25c5-4a17-9a40-af916f44f16f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] deleating volume v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] get snapshots for volume v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-7d988194-331e-432e-ad10-edbfb898558b-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-7d988194-331e-432e-ad10-edbfb898558b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_7d988194-331e-432e-ad10-edbfb898558b. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] get volume v_0beb75bd-25c5-4a17-9a40-af916f44f16f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0beb75bd-25c5-4a17-9a40-af916f44f16f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439528', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111630', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10294307993520438716', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f6871415d08d3d74', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303320064', 'san:volume_id': 'f6871415d08d3d743920b766f2568d87b2b862da', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84225', 'name': 'v_0beb75bd-25c5-4a17-9a40-af916f44f16f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] delete volume:v_0beb75bd-25c5-4a17-9a40-af916f44f16f recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_7d988194-331e-432e-ad10-edbfb898558b info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_7d988194-331e-432e-ad10-edbfb898558b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_7d988194-331e-432e-ad10-edbfb898558b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439401', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111571', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14555004153280099388', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3179dc3dbda685b1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303320064', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83915', 'name': 's_7d988194-331e-432e-ad10-edbfb898558b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_7d988194-331e-432e-ad10-edbfb898558b of volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0beb75bd-25c5-4a17-9a40-af916f44f16f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] volume v_0beb75bd-25c5-4a17-9a40-af916f44f16f deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.quota [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Created reservations ['dadc8f84-9503-457e-91d0-75ca5c98e4a4', '2180d1fe-598b-4c84-b0a4-5184ff591041', '23363e0b-32e5-4afc-b5c6-c2e77daed563', '9dbf5c34-f395-473d-b394-fa8956d3c389'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_7d988194-331e-432e-ad10-edbfb898558b {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_7d988194-331e-432e-ad10-edbfb898558b deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=61,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:43 user cinder-volume[73579]: DEBUG cinder.quota [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['8d3ee81b-5374-485e-b543-f5734074008f', 'aface31b-19dc-4348-b0e2-0641ad43eb49', 'a68f3b33-c869-4e26-93c5-5ca48099ec91', '941da1d2-8cba-4760-bb57-c7c5a3b09998'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:08:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d8dbcc01-ac00-4e7c-a914-2b3aa5ab75d3 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-7d988194-331e-432e-ad10-edbfb898558b-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-c75e94b6-85e3-43f3-b703-33fbdeab45cd-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-c75e94b6-85e3-43f3-b703-33fbdeab45cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_c75e94b6-85e3-43f3-b703-33fbdeab45cd. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303401984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.manager [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:08:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Deleted volume successfully. Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.coordination [None req-16f4b554-22e2-42ee-9882-43ea218d656f tempest-VolumesActionsTest-370832694 None] Lock "cinder-0beb75bd-25c5-4a17-9a40-af916f44f16f-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_c75e94b6-85e3-43f3-b703-33fbdeab45cd info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449@s_c75e94b6-85e3-43f3-b703-33fbdeab45cd', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439522', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111619', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16591788564374383642', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c66a74e3eeff383c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303401984', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82623', 'name': 's_c75e94b6-85e3-43f3-b703-33fbdeab45cd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_c75e94b6-85e3-43f3-b703-33fbdeab45cd of volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:08:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (9021782e-8681-45e4-bf30-f21fc0981dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1da273-bbaa-4fe9-a7d7-a8af1d23cc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1da273-bbaa-4fe9-a7d7-a8af1d23cc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-47181805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1c9e113c-74b4-4571-a63e-89084ec626a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:08:45Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fafd27d-49d5-419f-b6c0-a43c1f9a95c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fafd27d-49d5-419f-b6c0-a43c1f9a95c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8403774f-bc9a-485a-8d97-45bd648c284f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8403774f-bc9a-485a-8d97-45bd648c284f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9e113c-74b4-4571-a63e-89084ec626a0', 'volume_name': 'volume-1c9e113c-74b4-4571-a63e-89084ec626a0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cffe67-7302-4578-b1bf-e9b9f029261c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cffe67-7302-4578-b1bf-e9b9f029261c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b408e7-2ce0-441e-a4d6-7d9f55d4d314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:45 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Volume 1c9e113c-74b4-4571-a63e-89084ec626a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9e113c-74b4-4571-a63e-89084ec626a0', 'volume_size': 1} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] creating volume v_1c9e113c-74b4-4571-a63e-89084ec626a0. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] create volume {'name': 'v_1c9e113c-74b4-4571-a63e-89084ec626a0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots/s_c75e94b6-85e3-43f3-b703-33fbdeab45cd {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_c75e94b6-85e3-43f3-b703-33fbdeab45cd deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.quota [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['46ac2993-e03a-4564-8824-124d4bc2caef', '3dd314bc-c091-4b5c-9946-c4989482a8f8', '88709a18-f051-4ea1-abc2-f85e2ca3d966', '556a2e1e-05f7-4a9a-98c8-ea259bbf0110'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1c9e113c-74b4-4571-a63e-89084ec626a0', 'is_clone': False, 'name': 'v_1c9e113c-74b4-4571-a63e-89084ec626a0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b408e7-2ce0-441e-a4d6-7d9f55d4d314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9e113c-74b4-4571-a63e-89084ec626a0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9961d64c-5215-4004-97a0-e102c400468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:46 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Volume volume-1c9e113c-74b4-4571-a63e-89084ec626a0 (1c9e113c-74b4-4571-a63e-89084ec626a0): created successfully Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9961d64c-5215-4004-97a0-e102c400468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (9021782e-8681-45e4-bf30-f21fc0981dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-81e99909-d2a9-4387-adf8-6e8a6c6c9c43 tempest-VolumesActionsTest-1128976857 None] Created volume successfully. Apr 14 02:08:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:08:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-8f71d799-cde6-4878-9fc5-80306cd2ec20 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-c75e94b6-85e3-43f3-b703-33fbdeab45cd-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Acquiring lock "cinder-1c9e113c-74b4-4571-a63e-89084ec626a0-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Lock "cinder-1c9e113c-74b4-4571-a63e-89084ec626a0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] remove_export for volume: 1c9e113c-74b4-4571-a63e-89084ec626a0. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-47181805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1c9e113c-74b4-4571-a63e-89084ec626a0,launched_at=2023-04-14T02:08:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth='CHAP UvBkhQiP MYKv1AgUqVkBuT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:45Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:08:47Z,updated_at=2023-04-14T02:08:47Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] detach volume v_1c9e113c-74b4-4571-a63e-89084ec626a0 from target iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0/luns/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0/luns/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0/luns/v_1c9e113c-74b4-4571-a63e-89084ec626a0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0/luns/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 because of JDSS resource v_1c9e113c-74b4-4571-a63e-89084ec626a0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] delete target: iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] delete target iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 because of JDSS resource iqn.2010-10.org.openstack:1c9e113c-74b4-4571-a63e-89084ec626a0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] deleating volume v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] get snapshots for volume v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] get volume v_1c9e113c-74b4-4571-a63e-89084ec626a0 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1c9e113c-74b4-4571-a63e-89084ec626a0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439534', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111643', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5012338906753903880', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd26128557fb8d392', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303356928', 'san:volume_id': 'd26128557fb8d3928cdd9ccb866ea8c286493461', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84135', 'name': 'v_1c9e113c-74b4-4571-a63e-89084ec626a0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] delete volume:v_1c9e113c-74b4-4571-a63e-89084ec626a0 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] terminate connection for 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:08:48 user cinder-volume[73579]: INFO cinder.volume.manager [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Terminate volume connection completed successfully. Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Deleting attachment 3fad3d3a-fc9e-49ba-adad-dba96b56b680. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1711983709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449,launched_at=2023-04-14T02:03:10Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP kQWcapHS XvTzQ4WcL5qm1f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:09Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:08:48Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 from target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2622476e-84eb-40bf-8437-86ecbb69c377 req-ea32f4fd-e465-4ab5-90fd-598e88281a79 tempest-VolumesSnapshotTestJSON-2121749885 None] target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9e113c-74b4-4571-a63e-89084ec626a0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] volume v_1c9e113c-74b4-4571-a63e-89084ec626a0 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.quota [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Created reservations ['6461274d-a553-4868-8a00-8ad3dc07467e', '92ae5852-96ed-4533-bc28-1f41e4ab61cd', '325d411a-d510-44a3-ba6a-bc1ef28d75a1', 'c0ac193d-f6bc-43d6-8167-77816fc02c12'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303438848', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.manager [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:08:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Deleted volume successfully. Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-d61d338a-d4ee-41c6-b8ee-2680d7503571 tempest-VolumesActionsTest-370832694 None] Lock "cinder-1c9e113c-74b4-4571-a63e-89084ec626a0-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (be040002-93d0-4c75-9e8b-27c04b543676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54d20af-f4da-4c89-a4e4-16a19a77c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54d20af-f4da-4c89-a4e4-16a19a77c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-41074214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=87a6af97-05f5-4074-8272-83c5042ea323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:08:51Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c7000f-67a5-4980-8b17-44614ecbd13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c7000f-67a5-4980-8b17-44614ecbd13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c373c12-3993-4b9c-bd7b-a64216e5b5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c373c12-3993-4b9c-bd7b-a64216e5b5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a6af97-05f5-4074-8272-83c5042ea323', 'volume_name': 'volume-87a6af97-05f5-4074-8272-83c5042ea323', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36b64a8-48b7-4097-8018-6bc4900c0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36b64a8-48b7-4097-8018-6bc4900c0b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a088de2d-402d-4a3f-a8d3-a0d0ea349156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:50 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Volume 87a6af97-05f5-4074-8272-83c5042ea323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a6af97-05f5-4074-8272-83c5042ea323', 'volume_size': 1} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] creating volume v_87a6af97-05f5-4074-8272-83c5042ea323. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] create volume {'name': 'v_87a6af97-05f5-4074-8272-83c5042ea323', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_87a6af97-05f5-4074-8272-83c5042ea323', 'is_clone': False, 'name': 'v_87a6af97-05f5-4074-8272-83c5042ea323'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a088de2d-402d-4a3f-a8d3-a0d0ea349156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a6af97-05f5-4074-8272-83c5042ea323', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e323b0ca-7870-4597-9077-7d0c7a9ee11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:51 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Volume volume-87a6af97-05f5-4074-8272-83c5042ea323 (87a6af97-05f5-4074-8272-83c5042ea323): created successfully Apr 14 02:08:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e323b0ca-7870-4597-9077-7d0c7a9ee11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:51 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (be040002-93d0-4c75-9e8b-27c04b543676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:51 user cinder-volume[73579]: INFO cinder.volume.manager [None req-45ab36f3-0fb2-4db7-88f9-7300faae07df tempest-VolumesActionsTest-1128976857 None] Created volume successfully. Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Acquiring lock "cinder-87a6af97-05f5-4074-8272-83c5042ea323-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Lock "cinder-87a6af97-05f5-4074-8272-83c5042ea323-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] remove_export for volume: 87a6af97-05f5-4074-8272-83c5042ea323. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-41074214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=87a6af97-05f5-4074-8272-83c5042ea323,launched_at=2023-04-14T02:08:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth='CHAP xYhEVXjK KfVcCXzYDehrUR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:51Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:08:53Z,updated_at=2023-04-14T02:08:53Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] detach volume v_87a6af97-05f5-4074-8272-83c5042ea323 from target iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323/luns/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323/luns/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323/luns/v_87a6af97-05f5-4074-8272-83c5042ea323'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323/luns/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 because of JDSS resource v_87a6af97-05f5-4074-8272-83c5042ea323 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] delete target: iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] delete target iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 because of JDSS resource iqn.2010-10.org.openstack:87a6af97-05f5-4074-8272-83c5042ea323 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] deleating volume v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] get snapshots for volume v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] get volume v_87a6af97-05f5-4074-8272-83c5042ea323 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_87a6af97-05f5-4074-8272-83c5042ea323', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439540', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111650', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2230281764692299968', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0793acf766e9f967', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303332352', 'san:volume_id': '0793acf766e9f967c9245f91eb6274d4142eaa2b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83924', 'name': 'v_87a6af97-05f5-4074-8272-83c5042ea323', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] delete volume:v_87a6af97-05f5-4074-8272-83c5042ea323 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87a6af97-05f5-4074-8272-83c5042ea323 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] volume v_87a6af97-05f5-4074-8272-83c5042ea323 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:08:55 user cinder-volume[73579]: DEBUG cinder.quota [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Created reservations ['030125f1-f193-431e-8506-29eba6a60756', '388769e3-f510-4924-8e04-05840e60c0c3', 'ee2dd927-6980-4e50-8b0d-acaf432763ac', '71cf9c38-c453-467f-a2e6-31ac8158e805'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:08:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:08:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:08:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303414272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.manager [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:08:56 user cinder-volume[73579]: INFO cinder.volume.manager [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Deleted volume successfully. Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.coordination [None req-441f9b70-6fe7-498d-8a64-a38fdb61e556 tempest-VolumesActionsTest-370832694 None] Lock "cinder-87a6af97-05f5-4074-8272-83c5042ea323-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (1fe54d95-1a1d-4145-91b0-29d753037a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efb0a83-8ec7-47a1-afbc-a43d4a60f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efb0a83-8ec7-47a1-afbc-a43d4a60f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1500206948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f785a4fc-1e2c-4c45-8896-241000fe5978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:08:57Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bcbd97-58c4-4f9b-bd11-cd1775e539a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bcbd97-58c4-4f9b-bd11-cd1775e539a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dea1d79-a1d6-40d3-bae1-520a0e2360f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dea1d79-a1d6-40d3-bae1-520a0e2360f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f785a4fc-1e2c-4c45-8896-241000fe5978', 'volume_name': 'volume-f785a4fc-1e2c-4c45-8896-241000fe5978', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2455641-0dc5-411d-97eb-ecf0bdce186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2455641-0dc5-411d-97eb-ecf0bdce186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2725767-9774-459e-96b9-24e336158bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:56 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Volume f785a4fc-1e2c-4c45-8896-241000fe5978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f785a4fc-1e2c-4c45-8896-241000fe5978', 'volume_size': 1} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] creating volume v_f785a4fc-1e2c-4c45-8896-241000fe5978. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] create volume {'name': 'v_f785a4fc-1e2c-4c45-8896-241000fe5978', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f785a4fc-1e2c-4c45-8896-241000fe5978', 'is_clone': False, 'name': 'v_f785a4fc-1e2c-4c45-8896-241000fe5978'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2725767-9774-459e-96b9-24e336158bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f785a4fc-1e2c-4c45-8896-241000fe5978', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5be694-777e-4ae6-9f99-f2ddde997dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:08:57 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Volume volume-f785a4fc-1e2c-4c45-8896-241000fe5978 (f785a4fc-1e2c-4c45-8896-241000fe5978): created successfully Apr 14 02:08:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5be694-777e-4ae6-9f99-f2ddde997dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:08:57 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (1fe54d95-1a1d-4145-91b0-29d753037a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:08:57 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2199322f-f81b-4884-b29d-4ea969f67bf6 tempest-VolumesActionsTest-1128976857 None] Created volume successfully. Apr 14 02:08:57 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=59,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Acquiring lock "cinder-f785a4fc-1e2c-4c45-8896-241000fe5978-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Lock "cinder-f785a4fc-1e2c-4c45-8896-241000fe5978-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] remove_export for volume: f785a4fc-1e2c-4c45-8896-241000fe5978. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1500206948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f785a4fc-1e2c-4c45-8896-241000fe5978,launched_at=2023-04-14T02:08:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth='CHAP VrfeTLlX fGxCvZLp9sbHXI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:08:57Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:08:59Z,updated_at=2023-04-14T02:08:59Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] detach volume v_f785a4fc-1e2c-4c45-8896-241000fe5978 from target iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978/luns/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978/luns/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978/luns/v_f785a4fc-1e2c-4c45-8896-241000fe5978'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978/luns/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 because of JDSS resource v_f785a4fc-1e2c-4c45-8896-241000fe5978 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] delete target: iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] delete target iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] failed to remove resource iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 because of JDSS resource iqn.2010-10.org.openstack:f785a4fc-1e2c-4c45-8896-241000fe5978 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] deleating volume v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] get snapshots for volume v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] get volume v_f785a4fc-1e2c-4c45-8896-241000fe5978 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f785a4fc-1e2c-4c45-8896-241000fe5978', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439546', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111655', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4852085643757422219', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5210551d44ffea7c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303332352', 'san:volume_id': '5210551d44ffea7c09d7e1d0602a0843689ee3c3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83545', 'name': 'v_f785a4fc-1e2c-4c45-8896-241000fe5978', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] delete volume:v_f785a4fc-1e2c-4c45-8896-241000fe5978 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:08:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f785a4fc-1e2c-4c45-8896-241000fe5978 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] volume v_f785a4fc-1e2c-4c45-8896-241000fe5978 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:09:01 user cinder-volume[73579]: DEBUG cinder.quota [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Created reservations ['b688407f-319d-4ff5-b443-1229e3a27476', 'be850d68-8832-45eb-aba4-44ecdfee0a7e', '27bdef4a-a88b-4ff1-b366-d99bdca641f4', 'df8c9a0a-196c-4950-8228-4012a9e9296d'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:09:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:09:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:09:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303414272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.manager [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:09:02 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Deleted volume successfully. Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2ba86adf-1e59-4f00-8b69-d917448fcbdb tempest-VolumesActionsTest-370832694 None] Lock "cinder-f785a4fc-1e2c-4c45-8896-241000fe5978-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (7d502bbe-48a0-44fd-a4ed-bcac21c5f066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f35e697-22f5-4bb3-876d-ac0bff53955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f35e697-22f5-4bb3-876d-ac0bff53955d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677662075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=dcaa0364-5806-43ea-853c-2046737161ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:09:03Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dfab10-cc86-417c-bcfc-4f06af891193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dfab10-cc86-417c-bcfc-4f06af891193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f969ff-beb2-4722-9277-da6bc84f2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f969ff-beb2-4722-9277-da6bc84f2f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcaa0364-5806-43ea-853c-2046737161ae', 'volume_name': 'volume-dcaa0364-5806-43ea-853c-2046737161ae', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0be5c9b-9501-4bdb-ad28-ca9bdf6509d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0be5c9b-9501-4bdb-ad28-ca9bdf6509d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d33be0-9ea4-4a06-b48b-bffd2f857617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Volume dcaa0364-5806-43ea-853c-2046737161ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcaa0364-5806-43ea-853c-2046737161ae', 'volume_size': 1} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] creating volume v_dcaa0364-5806-43ea-853c-2046737161ae. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] create volume {'name': 'v_dcaa0364-5806-43ea-853c-2046737161ae', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_dcaa0364-5806-43ea-853c-2046737161ae', 'is_clone': False, 'name': 'v_dcaa0364-5806-43ea-853c-2046737161ae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d33be0-9ea4-4a06-b48b-bffd2f857617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcaa0364-5806-43ea-853c-2046737161ae', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe98b09-9a8a-4bd2-a7ef-07b803ecf731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Volume volume-dcaa0364-5806-43ea-853c-2046737161ae (dcaa0364-5806-43ea-853c-2046737161ae): created successfully Apr 14 02:09:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe98b09-9a8a-4bd2-a7ef-07b803ecf731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Flow 'volume_create_manager' (7d502bbe-48a0-44fd-a4ed-bcac21c5f066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-884492ec-d2be-41b1-b804-b7288cffc003 tempest-VolumesActionsTest-1128976857 None] Created volume successfully. Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Acquiring lock "cinder-dcaa0364-5806-43ea-853c-2046737161ae-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-dcaa0364-5806-43ea-853c-2046737161ae-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] remove_export for volume: dcaa0364-5806-43ea-853c-2046737161ae. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677662075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=dcaa0364-5806-43ea-853c-2046737161ae,launched_at=2023-04-14T02:09:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d826f5f9504efe95f0736f538951b4',provider_auth='CHAP ZXMzKFqo 0mpulY3VtxvSWw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:03Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:09:04Z,updated_at=2023-04-14T02:09:04Z,use_quota=True,user_id='97dc26d9782b4960af1ae5056a85616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] detach volume v_dcaa0364-5806-43ea-853c-2046737161ae from target iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae/luns/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae/luns/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae/luns/v_dcaa0364-5806-43ea-853c-2046737161ae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae/luns/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] failed to remove resource iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae because of JDSS resource v_dcaa0364-5806-43ea-853c-2046737161ae DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] delete target: iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] delete target iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] failed to remove resource iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae because of JDSS resource iqn.2010-10.org.openstack:dcaa0364-5806-43ea-853c-2046737161ae DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] deleating volume v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] get snapshots for volume v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] get volume v_dcaa0364-5806-43ea-853c-2046737161ae info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_dcaa0364-5806-43ea-853c-2046737161ae', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439552', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111660', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2439377762952493988', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '95e9f95cb5374253', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303320064', 'san:volume_id': '95e9f95cb5374253056f88104b1edfa4c2a00277', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83556', 'name': 'v_dcaa0364-5806-43ea-853c-2046737161ae', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] delete volume:v_dcaa0364-5806-43ea-853c-2046737161ae recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=50,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dcaa0364-5806-43ea-853c-2046737161ae {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] volume v_dcaa0364-5806-43ea-853c-2046737161ae deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:09:06 user cinder-volume[73579]: DEBUG cinder.quota [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Created reservations ['7cf59a2a-d0f2-4786-9409-66683135d128', 'ced6f351-0215-40f9-a682-352106538fca', '3b359e08-9467-4aa8-97a4-7d8294bdbe1a', '24e69616-ead2-4bb7-bbcf-5718be5e260a'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303401984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.manager [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:09:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Deleted volume successfully. Apr 14 02:09:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-081f650a-6645-4520-937c-98a417cec902 tempest-VolumesActionsTest-1128976857 None] Lock "cinder-dcaa0364-5806-43ea-853c-2046737161ae-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:09:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Acquiring lock "cinder-4c538a4c-d102-445d-bfef-2cb750d83cb9-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:09:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Lock "cinder-4c538a4c-d102-445d-bfef-2cb750d83cb9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] remove_export for volume: 4c538a4c-d102-445d-bfef-2cb750d83cb9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2125583498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4c538a4c-d102-445d-bfef-2cb750d83cb9,launched_at=2023-04-14T02:05:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27dc405e16434633956ed2cd7e1791cd',provider_auth='CHAP alqbUyWc 1GOaAWvKYMqPZe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:05:27Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=4fb682cc-012f-4147-abb3-0bc5272c850f,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:09:14Z,updated_at=2023-04-14T02:09:14Z,use_quota=True,user_id='7ae5170969344b9fa5294231f8ffbe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] detach volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 from target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns/v_4c538a4c-d102-445d-bfef-2cb750d83cb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9/luns/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] failed to remove resource iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 because of JDSS resource v_4c538a4c-d102-445d-bfef-2cb750d83cb9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] delete target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] delete target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] failed to remove resource iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 because of JDSS resource iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] deleating volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] get snapshots for volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] get volume v_4c538a4c-d102-445d-bfef-2cb750d83cb9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_4fb682cc-012f-4147-abb3-0bc5272c850f@v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439338', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '111534', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6055527989012336435', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '90112', 'logicalused': '303104', 'compressratio': '6.16', 'rootcontext': 'none', 'default_scsi_id': 'da5177e431041d7f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303401984', 'san:volume_id': 'da5177e431041d7ffe865a6a727db65821bef5f6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '90112', 'objsetid': '83660', 'name': 'v_4c538a4c-d102-445d-bfef-2cb750d83cb9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '90112', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] delete snapshot v_4c538a4c-d102-445d-bfef-2cb750d83cb9 of volume s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots/v_4c538a4c-d102-445d-bfef-2cb750d83cb9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] snapshot v_4c538a4c-d102-445d-bfef-2cb750d83cb9 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.quota [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Created reservations ['e956a502-3d2f-48ef-8c45-7901e60e0351', '7115e43e-66dc-4844-9625-93239b7f250a', 'a2eaeae8-6884-423b-8119-985419449e2c', '4d38043f-1922-405e-b15a-68ac761aac38'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Acquiring lock "cinder-4fb682cc-012f-4147-abb3-0bc5272c850f-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Lock "cinder-4fb682cc-012f-4147-abb3-0bc5272c850f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] deleating snapshot s_4fb682cc-012f-4147-abb3-0bc5272c850f. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] get snapshots for volume s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303565824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.manager [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:09:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Deleted volume successfully. Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1fb78a79-f6a9-490b-b072-a5465770b9ff tempest-TestStampPattern-190654074 None] Lock "cinder-4c538a4c-d102-445d-bfef-2cb750d83cb9-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] get volume s_4fb682cc-012f-4147-abb3-0bc5272c850f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32@s_4fb682cc-012f-4147-abb3-0bc5272c850f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_4fb682cc-012f-4147-abb3-0bc5272c850f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439329', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '111510', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16843163337311529983', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a2a6952f98d33cc7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303565824', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '83876', 'name': 's_4fb682cc-012f-4147-abb3-0bc5272c850f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] delete snapshot s_4fb682cc-012f-4147-abb3-0bc5272c850f of volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:09:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots/s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots/s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots/s_4fb682cc-012f-4147-abb3-0bc5272c850f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] snapshot s_4fb682cc-012f-4147-abb3-0bc5272c850f deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:09:18 user cinder-volume[73579]: DEBUG cinder.quota [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Created reservations ['10bad808-3c91-4129-9510-7100f24b035e', 'c6468f90-87d0-49eb-9327-ec71d2663338', '6e81ac51-ece5-4798-bb84-0cce6ddf83bd', 'b50444b9-131e-491d-80f6-f9839b3d9c31'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:09:18 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Delete snapshot completed successfully. Apr 14 02:09:18 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9c662365-ec6b-490e-938c-bec8676eda73 tempest-TestStampPattern-190654074 None] Lock "cinder-4fb682cc-012f-4147-abb3-0bc5272c850f-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:09:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:09:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:09:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:09:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303610880', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:09:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:09:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=49,cinder:UPDATE=38,cinder:INSERT=5,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (aee6dfa0-eeb1-4816-9f17-47797dfc69c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a8c4d2-6381-440d-aa82-ebf7c8ad77d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a8c4d2-6381-440d-aa82-ebf7c8ad77d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-328733970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:09:38Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586537be-e0aa-49a3-a2a4-f4efcd98c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586537be-e0aa-49a3-a2a4-f4efcd98c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d225f4-e3f6-4cce-ae2c-bfc6dc8b0c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d225f4-e3f6-4cce-ae2c-bfc6dc8b0c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'volume_name': 'volume-1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c71a180-f4d2-47c2-9d80-983e40712fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c71a180-f4d2-47c2-9d80-983e40712fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b07bb1b-a8a5-407b-aa3e-f08ca2f0fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:38 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Volume 1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'volume_size': 1} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] creating volume v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] create volume {'name': 'v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'is_clone': False, 'name': 'v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b07bb1b-a8a5-407b-aa3e-f08ca2f0fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8487ec5d-3b59-40eb-9fd6-8f20785074b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:39 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Volume volume-1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c (1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c): created successfully Apr 14 02:09:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8487ec5d-3b59-40eb-9fd6-8f20785074b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (aee6dfa0-eeb1-4816-9f17-47797dfc69c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:39 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b7d093e9-35ea-4c96-ba72-14cf9cf957ef tempest-VolumesSnapshotTestJSON-2121749885 None] Created volume successfully. Apr 14 02:09:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot c1a6f6f3-d113-4af1-bc50-5b946a60f98c for volume 1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:09:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c to s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:09:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:09:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c1a6f6f3-d113-4af1-bc50-5b946a60f98c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c from snapshot s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:09:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c@s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c', 'is_clone': True, 'full_name': 'Pool-0/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c', 'name': 's_c1a6f6f3-d113-4af1-bc50-5b946a60f98c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:09:42 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7e8353ef-1299-493e-a326-f3853265d4bb tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (ebadd823-e497-4b8d-854e-a3478b430797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b37e356-292b-4d9e-bf72-4bc79b8ccbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b37e356-292b-4d9e-bf72-4bc79b8ccbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-515474199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3edb4734-e2e4-4704-a46d-79c5a82998ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c1a6f6f3-d113-4af1-bc50-5b946a60f98c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:09:43Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00f5796-dcd6-4d5a-b2d5-eaead976a704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00f5796-dcd6-4d5a-b2d5-eaead976a704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f695b4e-ee49-4aac-85f8-f7a53750a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f695b4e-ee49-4aac-85f8-f7a53750a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3edb4734-e2e4-4704-a46d-79c5a82998ac', 'volume_name': 'volume-3edb4734-e2e4-4704-a46d-79c5a82998ac', 'volume_size': 2, 'snapshot_id': 'c1a6f6f3-d113-4af1-bc50-5b946a60f98c'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011e4eaa-8481-4d6c-b49f-73b4cf22efd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011e4eaa-8481-4d6c-b49f-73b4cf22efd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828ec5eb-6180-4ea4-9f7f-883caa53aae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume 3edb4734-e2e4-4704-a46d-79c5a82998ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3edb4734-e2e4-4704-a46d-79c5a82998ac', 'volume_size': 2, 'snapshot_id': 'c1a6f6f3-d113-4af1-bc50-5b946a60f98c'} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume 3edb4734-e2e4-4704-a46d-79c5a82998ac from snapshot c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c to v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_3edb4734-e2e4-4704-a46d-79c5a82998ac'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume v_3edb4734-e2e4-4704-a46d-79c5a82998ac from snapshot v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:09:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c@v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'is_clone': True, 'full_name': 'Pool-0/v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'name': 'v_3edb4734-e2e4-4704-a46d-79c5a82998ac'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_3edb4734-e2e4-4704-a46d-79c5a82998ac info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c@v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439593', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111689', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7101631480640217003', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9bb3b803aa9e5ea2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303479808', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83689', 'name': 'v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Extend volume 3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] jdss extend volume v_3edb4734-e2e4-4704-a46d-79c5a82998ac to 2147483648 {{(pid=73579) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828ec5eb-6180-4ea4-9f7f-883caa53aae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3edb4734-e2e4-4704-a46d-79c5a82998ac', 'volume_size': 2, 'snapshot_id': 'c1a6f6f3-d113-4af1-bc50-5b946a60f98c'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f14b93c-cd68-4fce-9e67-fe0fb207dd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:45 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume volume-3edb4734-e2e4-4704-a46d-79c5a82998ac (3edb4734-e2e4-4704-a46d-79c5a82998ac): created successfully Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f14b93c-cd68-4fce-9e67-fe0fb207dd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:45 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (ebadd823-e497-4b8d-854e-a3478b430797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:45 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7be1be05-a0d6-4d57-8404-44f495877e66 tempest-VolumesSnapshotTestJSON-2121749885 None] Created volume successfully. Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-3edb4734-e2e4-4704-a46d-79c5a82998ac-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-3edb4734-e2e4-4704-a46d-79c5a82998ac-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 3edb4734-e2e4-4704-a46d-79c5a82998ac. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-515474199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3edb4734-e2e4-4704-a46d-79c5a82998ac,launched_at=2023-04-14T02:09:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP dlYARkhM 7EatjoVIXnCsZu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=2,snapshot_id=c1a6f6f3-d113-4af1-bc50-5b946a60f98c,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:09:46Z,updated_at=2023-04-14T02:09:46Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_3edb4734-e2e4-4704-a46d-79c5a82998ac from target iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac/luns/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac/luns/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac/luns/v_3edb4734-e2e4-4704-a46d-79c5a82998ac'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac/luns/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac because of JDSS resource v_3edb4734-e2e4-4704-a46d-79c5a82998ac DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac because of JDSS resource iqn.2010-10.org.openstack:3edb4734-e2e4-4704-a46d-79c5a82998ac DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] deleating volume v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_3edb4734-e2e4-4704-a46d-79c5a82998ac info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c@v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439593', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111689', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7101631480640217003', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9bb3b803aa9e5ea2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303397888', 'san:volume_id': '9bb3b803aa9e5ea27b028afbc5d64502e262b3d4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83689', 'name': 'v_3edb4734-e2e4-4704-a46d-79c5a82998ac', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot v_3edb4734-e2e4-4704-a46d-79c5a82998ac of volume s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:09:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots/v_3edb4734-e2e4-4704-a46d-79c5a82998ac {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot v_3edb4734-e2e4-4704-a46d-79c5a82998ac deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.quota [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['e8fc0016-79c7-47cb-8298-b84efc1355af', '1ad1edbf-f35e-4f4a-ac04-3846114517d7', '436aba1d-1220-44b7-941f-f5f2f9124d44', '13b56a83-b2f2-4c32-9410-0a229df65af1'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-c1a6f6f3-d113-4af1-bc50-5b946a60f98c-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-c1a6f6f3-d113-4af1-bc50-5b946a60f98c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303492096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.manager [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:09:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Deleted volume successfully. Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.coordination [None req-2bec78fd-e736-45da-b43b-6ec7f540e9fc tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-3edb4734-e2e4-4704-a46d-79c5a82998ac-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c@s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439591', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111683', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5448791948625036412', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '41a115641c863085', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303492096', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82430', 'name': 's_c1a6f6f3-d113-4af1-bc50-5b946a60f98c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c of volume v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots/s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_c1a6f6f3-d113-4af1-bc50-5b946a60f98c deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.quota [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['a3f4d1bc-6827-4886-a102-7130e76f52e6', 'e0347d70-dd94-4214-8f16-044a71a756f5', '741a4cbc-7ffc-4f9a-9b5d-7c94c5aab469', '6555460b-1077-43ba-8b2a-b03c32279985'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:09:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-f86211ed-64e6-4bab-9cfa-257a73f5e2ec tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-c1a6f6f3-d113-4af1-bc50-5b946a60f98c-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-328733970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c,launched_at=2023-04-14T02:09:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP bkRItBjZ Uj7EXAk2ftxG5T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:38Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:09:51Z,updated_at=2023-04-14T02:09:51Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c from target iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/luns/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/luns/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/luns/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/luns/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c because of JDSS resource v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c because of JDSS resource iqn.2010-10.org.openstack:1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] deleating volume v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439588', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111677', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13630230421161902167', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fc97b40388459b39', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303504384', 'san:volume_id': 'fc97b40388459b39d3202498a7296318933a6fc1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83932', 'name': 'v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] delete volume:v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] volume v_1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.quota [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['179b5957-665a-4472-8679-286bba229848', '1ce26d5f-5b60-43ed-b5e0-e3dfe3bb4304', '87802a7c-5f19-4a30-a629-81632ceaf8a4', '85fe03dc-0059-4990-ae8f-2e4648842849'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303586304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.manager [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:09:53 user cinder-volume[73579]: INFO cinder.volume.manager [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Deleted volume successfully. Apr 14 02:09:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-311f9f9a-ec9b-4e0d-9476-46416b93aeaf tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-1bd4eec5-4dd4-4f9d-8556-eacbc74ee06c-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (2cb34cae-64ad-44b9-bab5-87572ff5a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6978677-952e-4814-b49f-7b8cdf0aadb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6978677-952e-4814-b49f-7b8cdf0aadb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1237373342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=93c4a726-391c-459b-bd1b-26e21880858e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:09:54Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd85452-ce6c-47d2-b165-79127508683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd85452-ce6c-47d2-b165-79127508683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b1c202-89b7-41ff-91c0-91690cab7a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b1c202-89b7-41ff-91c0-91690cab7a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c4a726-391c-459b-bd1b-26e21880858e', 'volume_name': 'volume-93c4a726-391c-459b-bd1b-26e21880858e', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cebadf-0a5c-4fd7-a016-3fb24a6e8eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cebadf-0a5c-4fd7-a016-3fb24a6e8eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e13fdaf-17ac-4571-87da-a20aac6f7344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:54 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume 93c4a726-391c-459b-bd1b-26e21880858e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c4a726-391c-459b-bd1b-26e21880858e', 'volume_size': 1} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] creating volume v_93c4a726-391c-459b-bd1b-26e21880858e. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume {'name': 'v_93c4a726-391c-459b-bd1b-26e21880858e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_93c4a726-391c-459b-bd1b-26e21880858e', 'is_clone': False, 'name': 'v_93c4a726-391c-459b-bd1b-26e21880858e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e13fdaf-17ac-4571-87da-a20aac6f7344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c4a726-391c-459b-bd1b-26e21880858e', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2556b683-1fed-42ed-b71e-7138cc9bdd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:55 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume volume-93c4a726-391c-459b-bd1b-26e21880858e (93c4a726-391c-459b-bd1b-26e21880858e): created successfully Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2556b683-1fed-42ed-b71e-7138cc9bdd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (2cb34cae-64ad-44b9-bab5-87572ff5a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:55 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7b5a5711-0ea7-45ef-9d76-24616150c475 tempest-VolumesSnapshotTestJSON-2121749885 None] Created volume successfully. Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot 8cfa37a8-019f-412d-96f3-234dd621de83 for volume 93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] cloning v_93c4a726-391c-459b-bd1b-26e21880858e to s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_8cfa37a8-019f-412d-96f3-234dd621de83'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] create volume s_8cfa37a8-019f-412d-96f3-234dd621de83 from snapshot s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:09:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:56 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_93c4a726-391c-459b-bd1b-26e21880858e@s_8cfa37a8-019f-412d-96f3-234dd621de83', 'is_clone': True, 'full_name': 'Pool-0/s_8cfa37a8-019f-412d-96f3-234dd621de83', 'name': 's_8cfa37a8-019f-412d-96f3-234dd621de83'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] volume s_8cfa37a8-019f-412d-96f3-234dd621de83 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:09:57 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4305c1ab-16f5-4071-919a-410676fd27fe tempest-VolumesSnapshotTestJSON-2121749885 None] Create snapshot completed successfully Apr 14 02:09:57 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=63,cinder:UPDATE=31,cinder:DELETE=1,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:57 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=56,cinder:UPDATE=31,cinder:DELETE=6,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (7e78ca4f-c6c0-40c4-acbc-1b1391a884e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21db1bab-0bb3-4124-807f-1c2f8adef3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21db1bab-0bb3-4124-807f-1c2f8adef3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1465512237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=05d591f9-6d7b-4216-a579-51718c729e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cfa37a8-019f-412d-96f3-234dd621de83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:09:58Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b82c2d4-80ee-4f9f-a1bb-f13bbd3a40c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b82c2d4-80ee-4f9f-a1bb-f13bbd3a40c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc4c3b8-aa9c-4674-baa0-f8036362abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc4c3b8-aa9c-4674-baa0-f8036362abce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05d591f9-6d7b-4216-a579-51718c729e90', 'volume_name': 'volume-05d591f9-6d7b-4216-a579-51718c729e90', 'volume_size': 1, 'snapshot_id': '8cfa37a8-019f-412d-96f3-234dd621de83'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d127cf2b-ece6-4442-9c65-5cf1e8be474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d127cf2b-ece6-4442-9c65-5cf1e8be474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3343a9a0-39b7-4b23-a1e1-fad7f781ad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:09:58 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume 05d591f9-6d7b-4216-a579-51718c729e90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05d591f9-6d7b-4216-a579-51718c729e90', 'volume_size': 1, 'snapshot_id': '8cfa37a8-019f-412d-96f3-234dd621de83'} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume 05d591f9-6d7b-4216-a579-51718c729e90 from snapshot 8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] cloning s_8cfa37a8-019f-412d-96f3-234dd621de83 to v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] create snapshot v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Acquiring lock "cinder-55aa3df5-b363-4e8f-ac2e-f46bea9ca67f-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-55aa3df5-b363-4e8f-ac2e-f46bea9ca67f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_05d591f9-6d7b-4216-a579-51718c729e90'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] create volume v_05d591f9-6d7b-4216-a579-51718c729e90 from snapshot v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2138434913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=55aa3df5-b363-4e8f-ac2e-f46bea9ca67f,launched_at=2023-04-14T01:54:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP vNWpMtFL cgFWzJqfrGivHB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:54:04Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:09:59Z,updated_at=2023-04-14T02:09:59Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] detach volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f from target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/luns/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] failed to remove resource iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f because of JDSS resource v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] failed to remove resource iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f because of JDSS resource iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] deleating volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] get snapshots for volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] get volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438653', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111077', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9262998755772786210', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '13c382db6b532b8c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303492096', 'san:volume_id': '13c382db6b532b8c8bd6941a3c645b078151e573', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83368', 'name': 'v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] delete volume:v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_8cfa37a8-019f-412d-96f3-234dd621de83@v_05d591f9-6d7b-4216-a579-51718c729e90', 'is_clone': True, 'full_name': 'Pool-0/v_05d591f9-6d7b-4216-a579-51718c729e90', 'name': 'v_05d591f9-6d7b-4216-a579-51718c729e90'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_05d591f9-6d7b-4216-a579-51718c729e90 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:09:59 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_8cfa37a8-019f-412d-96f3-234dd621de83@v_05d591f9-6d7b-4216-a579-51718c729e90', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_05d591f9-6d7b-4216-a579-51718c729e90', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439608', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111714', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14870892923152675885', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '15ac863ce9abb677', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303492096', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84510', 'name': 'v_05d591f9-6d7b-4216-a579-51718c729e90', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3343a9a0-39b7-4b23-a1e1-fad7f781ad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d591f9-6d7b-4216-a579-51718c729e90', 'volume_size': 1, 'snapshot_id': '8cfa37a8-019f-412d-96f3-234dd621de83'}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deface21-7d4f-4cc3-96f7-465352342c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:00 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Volume volume-05d591f9-6d7b-4216-a579-51718c729e90 (05d591f9-6d7b-4216-a579-51718c729e90): created successfully Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deface21-7d4f-4cc3-96f7-465352342c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Flow 'volume_create_manager' (7e78ca4f-c6c0-40c4-acbc-1b1391a884e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:00 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1070f9a6-93b5-4c9d-8265-25f921fb0573 tempest-VolumesSnapshotTestJSON-2121749885 None] Created volume successfully. Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-05d591f9-6d7b-4216-a579-51718c729e90-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-05d591f9-6d7b-4216-a579-51718c729e90-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 05d591f9-6d7b-4216-a579-51718c729e90. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1465512237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=05d591f9-6d7b-4216-a579-51718c729e90,launched_at=2023-04-14T02:10:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP SqVFskaK 7ei9qIE8d4VWkg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:58Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=8cfa37a8-019f-412d-96f3-234dd621de83,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:00Z,updated_at=2023-04-14T02:10:00Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_05d591f9-6d7b-4216-a579-51718c729e90 from target iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90/luns/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90/luns/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90/luns/v_05d591f9-6d7b-4216-a579-51718c729e90'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90/luns/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 because of JDSS resource v_05d591f9-6d7b-4216-a579-51718c729e90 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 because of JDSS resource iqn.2010-10.org.openstack:05d591f9-6d7b-4216-a579-51718c729e90 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating volume v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_05d591f9-6d7b-4216-a579-51718c729e90 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_8cfa37a8-019f-412d-96f3-234dd621de83@v_05d591f9-6d7b-4216-a579-51718c729e90', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_05d591f9-6d7b-4216-a579-51718c729e90', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439608', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111714', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14870892923152675885', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '15ac863ce9abb677', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303561728', 'san:volume_id': '15ac863ce9abb67764ddef346ad1df42ff8709ce', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84510', 'name': 'v_05d591f9-6d7b-4216-a579-51718c729e90', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot v_05d591f9-6d7b-4216-a579-51718c729e90 of volume s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] volume v_55aa3df5-b363-4e8f-ac2e-f46bea9ca67f deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:01 user cinder-volume[73579]: DEBUG cinder.quota [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Created reservations ['769de978-6a81-48d4-a2b3-2cec05ecdc27', '636cee18-8b85-4ecc-a296-fbe38c441d78', '9ea54efe-6087-4856-ad60-cc5728bff12e', 'c7b15e90-5c45-4718-9d81-f0415c35a775'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots/v_05d591f9-6d7b-4216-a579-51718c729e90 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot v_05d591f9-6d7b-4216-a579-51718c729e90 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.quota [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['e41bba2c-55b7-469e-bb3d-d01ffbc31c4b', 'c5ad7394-fff0-4c46-9a65-30dd3c0f5f1f', 'ea474637-904f-4999-881d-d9165c985b27', '5c2acdb3-9fc3-4371-bcf0-b6cf4fca027b'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303586304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.manager [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:02 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Deleted volume successfully. Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1ec6d6a3-e564-4f70-b8a7-33ca75fa17af tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-55aa3df5-b363-4e8f-ac2e-f46bea9ca67f-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Acquiring lock "cinder-b1446339-0ce8-401e-b2e0-c4811b486a1a-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-b1446339-0ce8-401e-b2e0-c4811b486a1a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] remove_export for volume: b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1190624143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b1446339-0ce8-401e-b2e0-c4811b486a1a,launched_at=2023-04-14T01:49:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',provider_auth='CHAP MbmBcKyr FYMbrv68h7ApuU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:49:10Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:02Z,updated_at=2023-04-14T02:10:02Z,use_quota=True,user_id='78ccd1a1ec1b486981d850881734fe02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] detach volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a from target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a/luns/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] failed to remove resource iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a because of JDSS resource v_b1446339-0ce8-401e-b2e0-c4811b486a1a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] delete target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] delete target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] failed to remove resource iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a because of JDSS resource iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] deleating volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] get snapshots for volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-8cfa37a8-019f-412d-96f3-234dd621de83-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-8cfa37a8-019f-412d-96f3-234dd621de83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating snapshot s_8cfa37a8-019f-412d-96f3-234dd621de83. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] get volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b1446339-0ce8-401e-b2e0-c4811b486a1a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681438360', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '110833', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6265254728210086148', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9658d8b66a15d5e8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303586304', 'san:volume_id': '9658d8b66a15d5e8167d5e8c3366aedc8628f94e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83238', 'name': 'v_b1446339-0ce8-401e-b2e0-c4811b486a1a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] delete volume:v_b1446339-0ce8-401e-b2e0-c4811b486a1a recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303586304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.manager [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Deleted volume successfully. Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7afb68d2-c137-4b35-a389-a34cb027fad3 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-05d591f9-6d7b-4216-a579-51718c729e90-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume s_8cfa37a8-019f-412d-96f3-234dd621de83 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_93c4a726-391c-459b-bd1b-26e21880858e@s_8cfa37a8-019f-412d-96f3-234dd621de83', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_8cfa37a8-019f-412d-96f3-234dd621de83', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439606', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111708', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8994590300347509042', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '72e444036d2a49ee', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303586304', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84494', 'name': 's_8cfa37a8-019f-412d-96f3-234dd621de83', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] delete snapshot s_8cfa37a8-019f-412d-96f3-234dd621de83 of volume v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots/s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots/s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1446339-0ce8-401e-b2e0-c4811b486a1a {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] volume v_b1446339-0ce8-401e-b2e0-c4811b486a1a deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.quota [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Created reservations ['33f01c9a-1da9-4959-8bfa-c36f0df3107d', '90fa3e05-49a4-4501-8aac-e8e7f910e5f6', '4357ef9f-20f0-4600-8056-04976d4ee546', 'c3788a19-be32-45b5-a27a-0a6ca9b89f42'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots/s_8cfa37a8-019f-412d-96f3-234dd621de83 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] snapshot s_8cfa37a8-019f-412d-96f3-234dd621de83 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.quota [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['60adb8de-3961-4876-a62a-b77133154889', 'e50e0fc6-cffa-4d94-ad30-648e4624e632', '36d050ac-e12e-4127-b141-a73709c9821f', '942ea8b6-742c-4b01-8865-cd86c90f7c16'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Delete snapshot completed successfully. Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1f7accf1-caec-43ab-9f61-a2ea24635cb2 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-8cfa37a8-019f-412d-96f3-234dd621de83-delete_snapshot" released by "delete_snapshot" :: held 2.736s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303680512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.manager [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Deleted volume successfully. Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5a2e3ac1-f89f-421b-96c6-a988f0abdc33 tempest-ServerActionsTestJSON-2035821517 None] Lock "cinder-b1446339-0ce8-401e-b2e0-c4811b486a1a-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-93c4a726-391c-459b-bd1b-26e21880858e-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-93c4a726-391c-459b-bd1b-26e21880858e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 93c4a726-391c-459b-bd1b-26e21880858e. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1237373342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=93c4a726-391c-459b-bd1b-26e21880858e,launched_at=2023-04-14T02:09:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP KdEsMGyT PTCht5EwRDzKlZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:09:54Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:06Z,updated_at=2023-04-14T02:10:06Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_93c4a726-391c-459b-bd1b-26e21880858e from target iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e/luns/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e/luns/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e/luns/v_93c4a726-391c-459b-bd1b-26e21880858e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e/luns/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e because of JDSS resource v_93c4a726-391c-459b-bd1b-26e21880858e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e because of JDSS resource iqn.2010-10.org.openstack:93c4a726-391c-459b-bd1b-26e21880858e DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating volume v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_93c4a726-391c-459b-bd1b-26e21880858e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_93c4a726-391c-459b-bd1b-26e21880858e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439604', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111702', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17225404075719949858', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '99f04ae7ab611915', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303680512', 'san:volume_id': '99f04ae7ab6119159bb84201314567875add2361', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84481', 'name': 'v_93c4a726-391c-459b-bd1b-26e21880858e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] delete volume:v_93c4a726-391c-459b-bd1b-26e21880858e recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_93c4a726-391c-459b-bd1b-26e21880858e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] volume v_93c4a726-391c-459b-bd1b-26e21880858e deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=8 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.quota [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['5b0d7633-35c7-49bd-bd32-65f13b8d0744', '1501c4ff-1db6-4753-aaba-0c7fea5937f4', 'd2467fb4-f6fb-469a-8ded-400bc0b65e9e', 'f825c04f-b76c-44be-9f0f-34e2ee1f22b0'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303762432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.manager [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Deleted volume successfully. Apr 14 02:10:08 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ce35082a-26b3-4549-8683-383744ffe179 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-93c4a726-391c-459b-bd1b-26e21880858e-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Acquiring lock "cinder-5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.coordination [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] remove_export for volume: 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1711983709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449,launched_at=2023-04-14T02:03:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fba8f38142a41928f0d2e8ead3aab96',provider_auth='CHAP kQWcapHS XvTzQ4WcL5qm1f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:03:09Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:09Z,updated_at=2023-04-14T02:10:09Z,use_quota=True,user_id='fbb0e166c1f448cbba774b835f9798c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] detach volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 from target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/luns/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 because of JDSS resource v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] delete target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] failed to remove resource iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 because of JDSS resource iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] deleating volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] get snapshots for volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] get volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439198', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111340', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2422447116668896565', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4008b23660890311', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303762432', 'san:volume_id': '4008b23660890311363037bc6a37e916f77bb108', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '81404', 'name': 'v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] delete volume:v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Acquiring lock "cinder-d6e664bf-00ef-4bb1-835c-e96535d4bb32-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Lock "cinder-d6e664bf-00ef-4bb1-835c-e96535d4bb32-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] remove_export for volume: d6e664bf-00ef-4bb1-835c-e96535d4bb32. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-952640453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d6e664bf-00ef-4bb1-835c-e96535d4bb32,launched_at=2023-04-14T02:02:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27dc405e16434633956ed2cd7e1791cd',provider_auth='CHAP kUVxZKGQ WHSTJngefFqcaR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:02:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:11Z,updated_at=2023-04-14T02:10:11Z,use_quota=True,user_id='7ae5170969344b9fa5294231f8ffbe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] detach volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 from target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32/luns/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] failed to remove resource iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 because of JDSS resource v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] delete target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] delete target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] failed to remove resource iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 because of JDSS resource iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] deleating volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] get snapshots for volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] volume v_5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.quota [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Created reservations ['c74dc61c-daba-4904-af1b-a97d9cd66ae6', 'd89f5551-3a96-44d2-85a5-ab930c2d284c', 'ea3826d4-782b-40fd-9f18-ece2b38cd445', 'd9e571d6-8f67-4d10-9124-016d85b853da'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] get volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439153', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '111312', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1319364826855846518', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '163840', 'logicalused': '1630208', 'compressratio': '15.30', 'rootcontext': 'none', 'default_scsi_id': 'c19bbb716869c319', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303893504', 'san:volume_id': 'c19bbb716869c3193a8eb52de8e11688238196cb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '163840', 'objsetid': '82930', 'name': 'v_d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '163840', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] delete volume:v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303893504', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:12 user cinder-volume[73579]: DEBUG cinder.manager [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:12 user cinder-volume[73579]: INFO cinder.volume.manager [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Deleted volume successfully. Apr 14 02:10:12 user cinder-volume[73579]: DEBUG cinder.coordination [None req-56d8f4e9-95c5-4a63-b315-6687c6d3b6f0 tempest-VolumesSnapshotTestJSON-2121749885 None] Lock "cinder-5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] volume v_d6e664bf-00ef-4bb1-835c-e96535d4bb32 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.quota [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Created reservations ['5a8160ad-bebd-467d-83b7-8825364cba27', 'bfbaf149-ab0d-4a8b-82eb-c82df2ba2083', '9fb18f2c-33fc-4c91-9067-7e95ad7c3163', '5c00cc1e-9df9-4ce6-bf77-a42cec30c78c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304094208', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.manager [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:14 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Deleted volume successfully. Apr 14 02:10:14 user cinder-volume[73579]: DEBUG cinder.coordination [None req-b7543e02-1967-4c1a-922a-e2fe4867db33 tempest-TestStampPattern-190654074 None] Lock "cinder-d6e664bf-00ef-4bb1-835c-e96535d4bb32-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=33,cinder:INSERT=6,cinder:UPDATE=29 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (671fa389-2368-44ad-aead-9eda38b4fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3722f189-cce1-4a4f-9bed-748029cf2bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3722f189-cce1-4a4f-9bed-748029cf2bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313333881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=352679b8-1a99-43b9-99c8-6a9252459c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:10:24Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de00557-03fd-4234-83fb-d29955e617d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de00557-03fd-4234-83fb-d29955e617d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51edfdf6-8fbe-4f35-afc1-828e93188bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51edfdf6-8fbe-4f35-afc1-828e93188bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352679b8-1a99-43b9-99c8-6a9252459c28', 'volume_name': 'volume-352679b8-1a99-43b9-99c8-6a9252459c28', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ca00c6-c1e5-406d-bfda-5ab3f6f8ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ca00c6-c1e5-406d-bfda-5ab3f6f8ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7156070-9419-4b09-bb0c-99cc7fdf03ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume 352679b8-1a99-43b9-99c8-6a9252459c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352679b8-1a99-43b9-99c8-6a9252459c28', 'volume_size': 1} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] creating volume v_352679b8-1a99-43b9-99c8-6a9252459c28. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] create volume {'name': 'v_352679b8-1a99-43b9-99c8-6a9252459c28', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_352679b8-1a99-43b9-99c8-6a9252459c28', 'is_clone': False, 'name': 'v_352679b8-1a99-43b9-99c8-6a9252459c28'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7156070-9419-4b09-bb0c-99cc7fdf03ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352679b8-1a99-43b9-99c8-6a9252459c28', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64870fb1-63b4-4854-a9b0-f11f8d33f2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:25 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume volume-352679b8-1a99-43b9-99c8-6a9252459c28 (352679b8-1a99-43b9-99c8-6a9252459c28): created successfully Apr 14 02:10:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64870fb1-63b4-4854-a9b0-f11f8d33f2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (671fa389-2368-44ad-aead-9eda38b4fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-24064720-f0d6-401e-9546-ed5b603ebc2a tempest-CreateVolumesFromSnapshotTest-250155148 None] Created volume successfully. Apr 14 02:10:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] create snapshot f9d865b9-6d98-4911-a330-7e7ff6148d20 for volume 352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:10:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] cloning v_352679b8-1a99-43b9-99c8-6a9252459c28 to s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:10:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] create snapshot s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:10:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f9d865b9-6d98-4911-a330-7e7ff6148d20'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] create volume s_f9d865b9-6d98-4911-a330-7e7ff6148d20 from snapshot s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:10:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_352679b8-1a99-43b9-99c8-6a9252459c28@s_f9d865b9-6d98-4911-a330-7e7ff6148d20', 'is_clone': True, 'full_name': 'Pool-0/s_f9d865b9-6d98-4911-a330-7e7ff6148d20', 'name': 's_f9d865b9-6d98-4911-a330-7e7ff6148d20'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] volume s_f9d865b9-6d98-4911-a330-7e7ff6148d20 properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:10:28 user cinder-volume[73579]: INFO cinder.volume.manager [None req-96f55bbd-dd39-41bd-b6fe-3073b9e80088 tempest-CreateVolumesFromSnapshotTest-250155148 None] Create snapshot completed successfully Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (9666a3a0-df46-442a-ab09-76be6985c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76abdaaa-53c9-43df-b78b-04d1731731a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76abdaaa-53c9-43df-b78b-04d1731731a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056975413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ac278e2-335e-4ba2-b0af-6a0099b0baf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:10:29Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da9967-8248-4a47-bf24-818517912045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da9967-8248-4a47-bf24-818517912045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8d0c70-d1a7-4532-8970-966469af31f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8d0c70-d1a7-4532-8970-966469af31f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'volume_name': 'volume-0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7571df9e-c4d7-43df-af7e-5e9b2a1e24fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7571df9e-c4d7-43df-af7e-5e9b2a1e24fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4997a542-cf0c-455b-b9c1-641c812d833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume 0ac278e2-335e-4ba2-b0af-6a0099b0baf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'volume_size': 1} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] creating volume v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] create volume {'name': 'v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (0b44094d-149c-4393-92ef-eebf4351ca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5978a118-c1b3-43dd-93f1-2fd016589bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5978a118-c1b3-43dd-93f1-2fd016589bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70367148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2caa3120-428d-44ea-933e-97289857c2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:10:29Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cdbbb0-b24c-44c1-a3f5-77b8119bdaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cdbbb0-b24c-44c1-a3f5-77b8119bdaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529f1321-8cd7-42c9-af3b-468bd3faa9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529f1321-8cd7-42c9-af3b-468bd3faa9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2caa3120-428d-44ea-933e-97289857c2d0', 'volume_name': 'volume-2caa3120-428d-44ea-933e-97289857c2d0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3923b8a4-e155-4bc7-826a-241168a3ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3923b8a4-e155-4bc7-826a-241168a3ee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6037dea3-c6ea-436d-b6dd-2fdaa714b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume 2caa3120-428d-44ea-933e-97289857c2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2caa3120-428d-44ea-933e-97289857c2d0', 'volume_size': 1} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] creating volume v_2caa3120-428d-44ea-933e-97289857c2d0. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] create volume {'name': 'v_2caa3120-428d-44ea-933e-97289857c2d0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (28e72fd5-370e-40db-a305-aab268aafde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed630f66-98ab-49fc-b55b-2cf1cb682862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed630f66-98ab-49fc-b55b-2cf1cb682862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975755048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0973e443-d90c-43fd-8f6c-d309247c07cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:10:30Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10536786-cf45-4776-9be8-4a1cc8915130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10536786-cf45-4776-9be8-4a1cc8915130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c24574-a811-4637-bb0a-59b0021122f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c24574-a811-4637-bb0a-59b0021122f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0973e443-d90c-43fd-8f6c-d309247c07cb', 'volume_name': 'volume-0973e443-d90c-43fd-8f6c-d309247c07cb', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520daa3f-4a4d-4382-ba2c-bdcf3ae4c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520daa3f-4a4d-4382-ba2c-bdcf3ae4c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add80ca6-df99-4cab-809d-94c46d39ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume 0973e443-d90c-43fd-8f6c-d309247c07cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0973e443-d90c-43fd-8f6c-d309247c07cb', 'volume_size': 1} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] creating volume v_0973e443-d90c-43fd-8f6c-d309247c07cb. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] create volume {'name': 'v_0973e443-d90c-43fd-8f6c-d309247c07cb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (4c187612-48c1-479b-b3dd-dfc16f97d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf2ce62-f5df-4e42-a4e6-c9f507978971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf2ce62-f5df-4e42-a4e6-c9f507978971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-550782697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5a58bd5c-0443-41c1-a1b8-2fb388afa287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:10:30Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca94d05-4456-4a0c-a41a-c17dd0594c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca94d05-4456-4a0c-a41a-c17dd0594c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc24e193-4a1f-43d4-b790-ad8578986138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc24e193-4a1f-43d4-b790-ad8578986138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'volume_name': 'volume-5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4c3346-32fc-4fe8-9e20-ea00739e4e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4c3346-32fc-4fe8-9e20-ea00739e4e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca5601f-edcd-42b7-894c-1ec65fa298d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume 5a58bd5c-0443-41c1-a1b8-2fb388afa287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'volume_size': 1} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] creating volume v_5a58bd5c-0443-41c1-a1b8-2fb388afa287. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] create volume {'name': 'v_5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (a3eeb42b-621d-4e67-8248-7c25090ff509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1375cff-3766-4db3-b366-a1295568ace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1375cff-3766-4db3-b366-a1295568ace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1269128313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d7388a36-b2a9-470b-acd6-c2730c6c0682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:10:30Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5d91ec-d207-4754-9ad2-ef2e872d308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5d91ec-d207-4754-9ad2-ef2e872d308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556f6385-7c4f-44a1-a56f-615959faf9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556f6385-7c4f-44a1-a56f-615959faf9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7388a36-b2a9-470b-acd6-c2730c6c0682', 'volume_name': 'volume-d7388a36-b2a9-470b-acd6-c2730c6c0682', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65269a0b-ccb4-4852-87c9-28ce97401799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65269a0b-ccb4-4852-87c9-28ce97401799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724c44db-cd37-40b5-a868-980fe7d5bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume d7388a36-b2a9-470b-acd6-c2730c6c0682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7388a36-b2a9-470b-acd6-c2730c6c0682', 'volume_size': 1} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] creating volume v_d7388a36-b2a9-470b-acd6-c2730c6c0682. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] create volume {'name': 'v_d7388a36-b2a9-470b-acd6-c2730c6c0682', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'is_clone': False, 'name': 'v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4997a542-cf0c-455b-b9c1-641c812d833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249fe80-ed1b-4431-a1b8-628c38ba117a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume volume-0ac278e2-335e-4ba2-b0af-6a0099b0baf7 (0ac278e2-335e-4ba2-b0af-6a0099b0baf7): created successfully Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249fe80-ed1b-4431-a1b8-628c38ba117a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (9666a3a0-df46-442a-ab09-76be6985c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-26638da1-84fe-449e-a2ef-7d39ba0b43b8 tempest-CreateVolumesFromSnapshotTest-250155148 None] Created volume successfully. Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0973e443-d90c-43fd-8f6c-d309247c07cb', 'is_clone': False, 'name': 'v_0973e443-d90c-43fd-8f6c-d309247c07cb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add80ca6-df99-4cab-809d-94c46d39ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0973e443-d90c-43fd-8f6c-d309247c07cb', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99e3653-01dc-4890-b28a-a8dd5d75f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume volume-0973e443-d90c-43fd-8f6c-d309247c07cb (0973e443-d90c-43fd-8f6c-d309247c07cb): created successfully Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99e3653-01dc-4890-b28a-a8dd5d75f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (28e72fd5-370e-40db-a305-aab268aafde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-76d80820-218b-46e9-b34d-45db50beb68b tempest-CreateVolumesFromSnapshotTest-250155148 None] Created volume successfully. Apr 14 02:10:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'is_clone': False, 'name': 'v_5a58bd5c-0443-41c1-a1b8-2fb388afa287'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca5601f-edcd-42b7-894c-1ec65fa298d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6303a001-62b0-4d4b-8e15-996ddb25ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume volume-5a58bd5c-0443-41c1-a1b8-2fb388afa287 (5a58bd5c-0443-41c1-a1b8-2fb388afa287): created successfully Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6303a001-62b0-4d4b-8e15-996ddb25ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (4c187612-48c1-479b-b3dd-dfc16f97d259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:30 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:INSERT=6,cinder:SELECT=62,cinder:UPDATE=27,cinder:DELETE=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-8d9e1c9f-a816-4898-a3b9-3c7a0ba1a5f3 tempest-CreateVolumesFromSnapshotTest-250155148 None] Created volume successfully. Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d7388a36-b2a9-470b-acd6-c2730c6c0682', 'is_clone': False, 'name': 'v_d7388a36-b2a9-470b-acd6-c2730c6c0682'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724c44db-cd37-40b5-a868-980fe7d5bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7388a36-b2a9-470b-acd6-c2730c6c0682', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc028a1-c761-49da-b2a7-c355837f38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:31 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume volume-d7388a36-b2a9-470b-acd6-c2730c6c0682 (d7388a36-b2a9-470b-acd6-c2730c6c0682): created successfully Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc028a1-c761-49da-b2a7-c355837f38cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (a3eeb42b-621d-4e67-8248-7c25090ff509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:31 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c79d5f74-e06b-43e6-84f6-3294a845332f tempest-CreateVolumesFromSnapshotTest-250155148 None] Created volume successfully. Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303709184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2caa3120-428d-44ea-933e-97289857c2d0', 'is_clone': False, 'name': 'v_2caa3120-428d-44ea-933e-97289857c2d0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6037dea3-c6ea-436d-b6dd-2fdaa714b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2caa3120-428d-44ea-933e-97289857c2d0', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f47e22-b214-4d76-b138-ee83eb6942a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:10:32 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Volume volume-2caa3120-428d-44ea-933e-97289857c2d0 (2caa3120-428d-44ea-933e-97289857c2d0): created successfully Apr 14 02:10:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f47e22-b214-4d76-b138-ee83eb6942a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:10:32 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Flow 'volume_create_manager' (0b44094d-149c-4393-92ef-eebf4351ca98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:10:32 user cinder-volume[73579]: INFO cinder.volume.manager [None req-3786ad5f-5b8c-4d0c-a2ae-56bdef75d4ad tempest-CreateVolumesFromSnapshotTest-250155148 None] Created volume successfully. Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Acquiring lock "cinder-d7388a36-b2a9-470b-acd6-c2730c6c0682-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-d7388a36-b2a9-470b-acd6-c2730c6c0682-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] remove_export for volume: d7388a36-b2a9-470b-acd6-c2730c6c0682. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1269128313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d7388a36-b2a9-470b-acd6-c2730c6c0682,launched_at=2023-04-14T02:10:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth='CHAP cgjHMGpu 6Fk3NuKG5gTVyM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:30Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:34Z,updated_at=2023-04-14T02:10:34Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume v_d7388a36-b2a9-470b-acd6-c2730c6c0682 from target iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682/luns/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682/luns/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682/luns/v_d7388a36-b2a9-470b-acd6-c2730c6c0682'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682/luns/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 because of JDSS resource v_d7388a36-b2a9-470b-acd6-c2730c6c0682 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target: iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 because of JDSS resource iqn.2010-10.org.openstack:d7388a36-b2a9-470b-acd6-c2730c6c0682 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] deleating volume v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] get snapshots for volume v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] get volume v_d7388a36-b2a9-470b-acd6-c2730c6c0682 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d7388a36-b2a9-470b-acd6-c2730c6c0682', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439640', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111753', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13253960048957470859', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '23287c5ba92f0c6f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303590400', 'san:volume_id': '23287c5ba92f0c6f94f6d56378e23d374f542c43', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84549', 'name': 'v_d7388a36-b2a9-470b-acd6-c2730c6c0682', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] delete volume:v_d7388a36-b2a9-470b-acd6-c2730c6c0682 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7388a36-b2a9-470b-acd6-c2730c6c0682 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] volume v_d7388a36-b2a9-470b-acd6-c2730c6c0682 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.quota [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Created reservations ['77e142df-c898-45f6-b8a2-84c7f6b9be0f', '9a60dba9-d067-4433-9700-4c9fd6d4a707', 'bc59bb79-832c-40c9-b4e3-90665a07092f', '6b0a7b30-c9ca-4910-84f8-1b784b02877d'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303672320', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.manager [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:36 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Deleted volume successfully. Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1eda703b-d9ea-470e-b565-bf73a50d131d tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-d7388a36-b2a9-470b-acd6-c2730c6c0682-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Acquiring lock "cinder-5a58bd5c-0443-41c1-a1b8-2fb388afa287-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-5a58bd5c-0443-41c1-a1b8-2fb388afa287-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove_export for volume: 5a58bd5c-0443-41c1-a1b8-2fb388afa287. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-550782697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5a58bd5c-0443-41c1-a1b8-2fb388afa287,launched_at=2023-04-14T02:10:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth='CHAP zMEycDRZ EaTbPMUjyBrmWw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:30Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:37Z,updated_at=2023-04-14T02:10:37Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 from target iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287/luns/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287/luns/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287/luns/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287/luns/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 because of JDSS resource v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target: iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 because of JDSS resource iqn.2010-10.org.openstack:5a58bd5c-0443-41c1-a1b8-2fb388afa287 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] deleating volume v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] get snapshots for volume v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] get volume v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439639', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111749', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15034902098911551917', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'be832c700e18c23a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303672320', 'san:volume_id': 'be832c700e18c23a505cc3b1d0ad28dc08260b4d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84540', 'name': 'v_5a58bd5c-0443-41c1-a1b8-2fb388afa287', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete volume:v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] volume v_5a58bd5c-0443-41c1-a1b8-2fb388afa287 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG cinder.quota [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Created reservations ['755065b0-6b06-42d7-809d-a1244e8c42a6', '9df4f576-e4f4-4152-9270-0af7eef712d4', '15551c2d-d5ca-4646-a279-ea778e1010f3', 'ad82a93e-4df3-4d91-a981-560a15c3a951'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=57,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303766528', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.manager [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:40 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Deleted volume successfully. Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5e1db7dd-19c0-4a4a-8c24-3fc72b02d945 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-5a58bd5c-0443-41c1-a1b8-2fb388afa287-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Acquiring lock "cinder-0973e443-d90c-43fd-8f6c-d309247c07cb-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-0973e443-d90c-43fd-8f6c-d309247c07cb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove_export for volume: 0973e443-d90c-43fd-8f6c-d309247c07cb. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975755048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0973e443-d90c-43fd-8f6c-d309247c07cb,launched_at=2023-04-14T02:10:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth='CHAP cPlvOKTY 7H3BGWtjysEanz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:30Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:40Z,updated_at=2023-04-14T02:10:40Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume v_0973e443-d90c-43fd-8f6c-d309247c07cb from target iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb/luns/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb/luns/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb/luns/v_0973e443-d90c-43fd-8f6c-d309247c07cb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb/luns/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb because of JDSS resource v_0973e443-d90c-43fd-8f6c-d309247c07cb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target: iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb because of JDSS resource iqn.2010-10.org.openstack:0973e443-d90c-43fd-8f6c-d309247c07cb DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] deleating volume v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] get snapshots for volume v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] get volume v_0973e443-d90c-43fd-8f6c-d309247c07cb info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0973e443-d90c-43fd-8f6c-d309247c07cb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439639', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111745', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '275731195305105037', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8e7f7ca53d5eea3e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303766528', 'san:volume_id': '8e7f7ca53d5eea3ef895760111c9298228514c08', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84531', 'name': 'v_0973e443-d90c-43fd-8f6c-d309247c07cb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete volume:v_0973e443-d90c-43fd-8f6c-d309247c07cb recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0973e443-d90c-43fd-8f6c-d309247c07cb {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] volume v_0973e443-d90c-43fd-8f6c-d309247c07cb deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:42 user cinder-volume[73579]: DEBUG cinder.quota [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Created reservations ['a2b90950-ec1a-46e2-b1e3-f75989815dd3', '049225b1-de3a-4be4-9a1a-3bd249b6893e', '13a7ec6f-b0e4-4644-a48e-b03d3ff50472', '1956ec3c-d649-4429-bfda-4e5b65d6330d'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303836160', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.manager [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Deleted volume successfully. Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-896bd994-70c3-48e6-b913-06ba18602f21 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-0973e443-d90c-43fd-8f6c-d309247c07cb-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Acquiring lock "cinder-2caa3120-428d-44ea-933e-97289857c2d0-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-2caa3120-428d-44ea-933e-97289857c2d0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove_export for volume: 2caa3120-428d-44ea-933e-97289857c2d0. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70367148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2caa3120-428d-44ea-933e-97289857c2d0,launched_at=2023-04-14T02:10:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth='CHAP SnmDlTcL Enj2fAe7NaIczF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:29Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:44Z,updated_at=2023-04-14T02:10:44Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume v_2caa3120-428d-44ea-933e-97289857c2d0 from target iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0/luns/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0/luns/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0/luns/v_2caa3120-428d-44ea-933e-97289857c2d0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0/luns/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 because of JDSS resource v_2caa3120-428d-44ea-933e-97289857c2d0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target: iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 because of JDSS resource iqn.2010-10.org.openstack:2caa3120-428d-44ea-933e-97289857c2d0 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] deleating volume v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] get snapshots for volume v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] get volume v_2caa3120-428d-44ea-933e-97289857c2d0 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2caa3120-428d-44ea-933e-97289857c2d0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439641', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111758', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14413632752136816443', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8fe7f988fba0bd3d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303836160', 'san:volume_id': '8fe7f988fba0bd3db1c2ba411ba0b0e764820306', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84161', 'name': 'v_2caa3120-428d-44ea-933e-97289857c2d0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete volume:v_2caa3120-428d-44ea-933e-97289857c2d0 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2caa3120-428d-44ea-933e-97289857c2d0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] volume v_2caa3120-428d-44ea-933e-97289857c2d0 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:45 user cinder-volume[73579]: DEBUG cinder.quota [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Created reservations ['71aaabf0-110a-4fac-abea-afaf062e37e5', 'c8f13ff8-96b5-43b9-a8d7-06b726d7ffe6', '427f3af1-51b2-43ab-bc67-a7d4ff07ed21', '814be1f3-560e-41fe-bb51-a8e32c0417a4'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303918080', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.manager [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:46 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Deleted volume successfully. Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9f8964e0-6363-4332-b64b-41b2bed8dc38 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-2caa3120-428d-44ea-933e-97289857c2d0-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Acquiring lock "cinder-0ac278e2-335e-4ba2-b0af-6a0099b0baf7-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-0ac278e2-335e-4ba2-b0af-6a0099b0baf7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=53,cinder:UPDATE=32,cinder:DELETE=5,cinder:INSERT=10 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove_export for volume: 0ac278e2-335e-4ba2-b0af-6a0099b0baf7. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056975413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ac278e2-335e-4ba2-b0af-6a0099b0baf7,launched_at=2023-04-14T02:10:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth='CHAP VgpITXtL XQkJW1AKOSfUow',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:29Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:47Z,updated_at=2023-04-14T02:10:47Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 from target iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7/luns/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7/luns/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7/luns/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7/luns/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 because of JDSS resource v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target: iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:46 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 because of JDSS resource iqn.2010-10.org.openstack:0ac278e2-335e-4ba2-b0af-6a0099b0baf7 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] deleating volume v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] get snapshots for volume v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] get volume v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439638', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111742', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3225031078473351577', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd4c197c54c9ca665', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303918080', 'san:volume_id': 'd4c197c54c9ca665259fee9b8788cc15e939d418', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84523', 'name': 'v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] delete volume:v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] volume v_0ac278e2-335e-4ba2-b0af-6a0099b0baf7 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.quota [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Created reservations ['ee6982e6-3a9b-436d-b5fd-55bd138062cf', 'a5f1df6b-6aae-4517-8dc4-70c41649c921', '3a4f21fb-d591-468e-ae84-652901a178b4', 'c0d888b9-d754-4668-9b27-f328141cb686'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304000000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.manager [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Deleted volume successfully. Apr 14 02:10:49 user cinder-volume[73579]: DEBUG cinder.coordination [None req-4109e91f-82a5-48ee-9528-fb5d9c6ab033 tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-0ac278e2-335e-4ba2-b0af-6a0099b0baf7-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Acquiring lock "cinder-f9d865b9-6d98-4911-a330-7e7ff6148d20-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-f9d865b9-6d98-4911-a330-7e7ff6148d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] deleating snapshot s_f9d865b9-6d98-4911-a330-7e7ff6148d20. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] get snapshots for volume s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] get volume s_f9d865b9-6d98-4911-a330-7e7ff6148d20 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_352679b8-1a99-43b9-99c8-6a9252459c28@s_f9d865b9-6d98-4911-a330-7e7ff6148d20', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f9d865b9-6d98-4911-a330-7e7ff6148d20', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439637', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111738', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5999393400081652368', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '263d5983ce7c71a6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304000000', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84612', 'name': 's_f9d865b9-6d98-4911-a330-7e7ff6148d20', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] delete snapshot s_f9d865b9-6d98-4911-a330-7e7ff6148d20 of volume v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots/s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots/s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots/s_f9d865b9-6d98-4911-a330-7e7ff6148d20 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] snapshot s_f9d865b9-6d98-4911-a330-7e7ff6148d20 deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:10:52 user cinder-volume[73579]: DEBUG cinder.quota [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Created reservations ['0204d051-c4d5-47a8-9084-3cb2a48592c0', '256a160f-4a22-426f-ab3e-504a99976262', '6ccc07d1-a000-497e-b0b7-b81792b47273', 'ea77ceaf-4507-4a0c-89bf-89993fd7bfab'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:52 user cinder-volume[73579]: INFO cinder.volume.manager [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Delete snapshot completed successfully. Apr 14 02:10:52 user cinder-volume[73579]: DEBUG cinder.coordination [None req-0f1a1198-1510-4d3f-8372-fa62636c0c5a tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-f9d865b9-6d98-4911-a330-7e7ff6148d20-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Acquiring lock "cinder-352679b8-1a99-43b9-99c8-6a9252459c28-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-352679b8-1a99-43b9-99c8-6a9252459c28-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] remove_export for volume: 352679b8-1a99-43b9-99c8-6a9252459c28. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313333881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=352679b8-1a99-43b9-99c8-6a9252459c28,launched_at=2023-04-14T02:10:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e3818dcb80464ab279db2d460f3c1c',provider_auth='CHAP tYMjqAcf D4CPwbQScvNMkf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:10:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:10:53Z,updated_at=2023-04-14T02:10:53Z,use_quota=True,user_id='4177401c3df64ffda38c9835ae4a14c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] detach volume v_352679b8-1a99-43b9-99c8-6a9252459c28 from target iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28/luns/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28/luns/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28/luns/v_352679b8-1a99-43b9-99c8-6a9252459c28'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28/luns/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 because of JDSS resource v_352679b8-1a99-43b9-99c8-6a9252459c28 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target: iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] delete target iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] failed to remove resource iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 because of JDSS resource iqn.2010-10.org.openstack:352679b8-1a99-43b9-99c8-6a9252459c28 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] deleating volume v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] get snapshots for volume v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] get volume v_352679b8-1a99-43b9-99c8-6a9252459c28 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_352679b8-1a99-43b9-99c8-6a9252459c28', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439634', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111732', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13610388905700221702', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '64b703a9c912a6dc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114304024576', 'san:volume_id': '64b703a9c912a6dcc8b0e1c76ec8050ff59f8ae9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83575', 'name': 'v_352679b8-1a99-43b9-99c8-6a9252459c28', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] delete volume:v_352679b8-1a99-43b9-99c8-6a9252459c28 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_352679b8-1a99-43b9-99c8-6a9252459c28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] volume v_352679b8-1a99-43b9-99c8-6a9252459c28 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=60,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG cinder.quota [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Created reservations ['3b304a63-94f3-4a6c-941e-00aed73ca945', '0db571ac-3bb3-4939-897d-82c28f4261d4', '7965f0c5-0577-4080-b138-ae3e7923fe0f', 'aa27683e-debe-49e4-a2b3-36d3bcaba4a5'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:10:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:10:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304106496', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:10:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:10:58 user cinder-volume[73579]: DEBUG cinder.manager [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:10:58 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Deleted volume successfully. Apr 14 02:10:58 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ca6008a5-9b0d-438c-82da-e93452a5758e tempest-CreateVolumesFromSnapshotTest-250155148 None] Lock "cinder-352679b8-1a99-43b9-99c8-6a9252459c28-delete_volume" released by "delete_volume" :: held 4.966s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (97627f77-9c1a-4b30-8475-ef3328218642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f332e5c3-147f-404d-bd19-7713da3f8a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f332e5c3-147f-404d-bd19-7713da3f8a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1793190700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eebc89a1-e14e-438c-8852-d8b182c70cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:11:01Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5ac60d-69e2-49f7-b9ba-527e7b66b05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5ac60d-69e2-49f7-b9ba-527e7b66b05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63701e56-ddbd-4bac-9a89-07032505a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63701e56-ddbd-4bac-9a89-07032505a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebc89a1-e14e-438c-8852-d8b182c70cd2', 'volume_name': 'volume-eebc89a1-e14e-438c-8852-d8b182c70cd2', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4699a3e-d4ec-4ea4-bc9b-d282b0b99632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4699a3e-d4ec-4ea4-bc9b-d282b0b99632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e27447-7403-4873-9c30-25f54807ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:00 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume eebc89a1-e14e-438c-8852-d8b182c70cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebc89a1-e14e-438c-8852-d8b182c70cd2', 'volume_size': 1} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] creating volume v_eebc89a1-e14e-438c-8852-d8b182c70cd2. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] create volume {'name': 'v_eebc89a1-e14e-438c-8852-d8b182c70cd2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:00 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:01 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_eebc89a1-e14e-438c-8852-d8b182c70cd2', 'is_clone': False, 'name': 'v_eebc89a1-e14e-438c-8852-d8b182c70cd2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e27447-7403-4873-9c30-25f54807ea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebc89a1-e14e-438c-8852-d8b182c70cd2', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbc4f56-db4f-4ca1-9fad-18566b72b374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:01 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume volume-eebc89a1-e14e-438c-8852-d8b182c70cd2 (eebc89a1-e14e-438c-8852-d8b182c70cd2): created successfully Apr 14 02:11:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbc4f56-db4f-4ca1-9fad-18566b72b374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:01 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (97627f77-9c1a-4b30-8475-ef3328218642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:01 user cinder-volume[73579]: INFO cinder.volume.manager [None req-cbf0b75a-26e9-4f8e-967e-c824b51b1fc3 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created volume successfully. Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (3a1f296a-76c2-4278-8c64-e35ce23ebbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d837c56-56b9-4aba-a71b-505c26937a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d837c56-56b9-4aba-a71b-505c26937a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570066202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=23f74317-5acc-43f3-a82f-e0cf596afaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:11:02Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0a4b64-d839-4fa7-b292-f57ed1499d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0a4b64-d839-4fa7-b292-f57ed1499d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5817bd58-c3f2-4750-9218-59b31327dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5817bd58-c3f2-4750-9218-59b31327dc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f74317-5acc-43f3-a82f-e0cf596afaaf', 'volume_name': 'volume-23f74317-5acc-43f3-a82f-e0cf596afaaf', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c853dc5-2175-4961-92d3-731a8c5e6b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c853dc5-2175-4961-92d3-731a8c5e6b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b067d693-9a65-44a9-bb03-f2c670984bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume 23f74317-5acc-43f3-a82f-e0cf596afaaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f74317-5acc-43f3-a82f-e0cf596afaaf', 'volume_size': 1} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] creating volume v_23f74317-5acc-43f3-a82f-e0cf596afaaf. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] create volume {'name': 'v_23f74317-5acc-43f3-a82f-e0cf596afaaf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (737c07bb-95c0-45c5-bd18-a2db18f08654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0831ce-f294-432c-99c6-8464d4ff95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0831ce-f294-432c-99c6-8464d4ff95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2070077008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=91c7b53f-8dbc-4c82-af71-6347c5350642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:11:02Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daffcf9-dce7-4297-ab04-0fa85a647331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daffcf9-dce7-4297-ab04-0fa85a647331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1615e0b-0b5e-459c-abef-792e75e5d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1615e0b-0b5e-459c-abef-792e75e5d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c7b53f-8dbc-4c82-af71-6347c5350642', 'volume_name': 'volume-91c7b53f-8dbc-4c82-af71-6347c5350642', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11501e20-108c-45d0-bf44-067e99960962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11501e20-108c-45d0-bf44-067e99960962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c7946c-5de2-4589-a1cb-55782745ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume 91c7b53f-8dbc-4c82-af71-6347c5350642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c7b53f-8dbc-4c82-af71-6347c5350642', 'volume_size': 1} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] creating volume v_91c7b53f-8dbc-4c82-af71-6347c5350642. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] create volume {'name': 'v_91c7b53f-8dbc-4c82-af71-6347c5350642', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (73b5fa52-a6e7-4a1b-8255-3b00c7a00cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e86d83-a255-4f8c-a24c-e3a0c6983290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e86d83-a255-4f8c-a24c-e3a0c6983290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752983038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=69a10f5a-e384-45e5-9beb-71a608ad10d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:11:02Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935626d-0649-4110-9488-19bdc8e7979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935626d-0649-4110-9488-19bdc8e7979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b715a1ab-cf18-4588-8427-566cc48bbfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b715a1ab-cf18-4588-8427-566cc48bbfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a10f5a-e384-45e5-9beb-71a608ad10d8', 'volume_name': 'volume-69a10f5a-e384-45e5-9beb-71a608ad10d8', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63b340d-9bdb-466e-839e-bd4defcc9810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63b340d-9bdb-466e-839e-bd4defcc9810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e78c973-42f3-4f3a-922b-72de38a110c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume 69a10f5a-e384-45e5-9beb-71a608ad10d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a10f5a-e384-45e5-9beb-71a608ad10d8', 'volume_size': 1} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] creating volume v_69a10f5a-e384-45e5-9beb-71a608ad10d8. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] create volume {'name': 'v_69a10f5a-e384-45e5-9beb-71a608ad10d8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (72a0ffe3-b3b9-4983-b9ec-32aca9415eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c866b-7a20-4579-a1db-e20238b5aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c866b-7a20-4579-a1db-e20238b5aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404508738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=63a04eda-d0ab-4dba-b7c7-dfdc48a036c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:11:03Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e3d47b-adbf-4af0-90b8-c58744ccc01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e3d47b-adbf-4af0-90b8-c58744ccc01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48e9e3a-a2cb-47e8-b095-66b4ec2fe4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48e9e3a-a2cb-47e8-b095-66b4ec2fe4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'volume_name': 'volume-63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e4cca0-32e8-49d5-b071-13765e9f8e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e4cca0-32e8-49d5-b071-13765e9f8e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a617bc2-8d2f-4c7f-935a-48db9046698f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume 63a04eda-d0ab-4dba-b7c7-dfdc48a036c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'volume_size': 1} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] creating volume v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] create volume {'name': 'v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (ea0cab1c-2c04-4903-88c7-7a8d8c9f3d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2247a469-3dfd-4cee-938f-63f4debebf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2247a469-3dfd-4cee-938f-63f4debebf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622998783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6788e361-8ec1-44c9-9ddd-0534f073ee86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:11:03Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3d73c1-3153-4b62-8a9f-3e2d13e13794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3d73c1-3153-4b62-8a9f-3e2d13e13794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3ccef4-b18b-43d3-807d-e6813f3d1ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3ccef4-b18b-43d3-807d-e6813f3d1ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6788e361-8ec1-44c9-9ddd-0534f073ee86', 'volume_name': 'volume-6788e361-8ec1-44c9-9ddd-0534f073ee86', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce65bd96-d7a8-4606-b980-d69ab700606d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce65bd96-d7a8-4606-b980-d69ab700606d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca0300a-049d-4d49-a994-d2dc6fd07437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume 6788e361-8ec1-44c9-9ddd-0534f073ee86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6788e361-8ec1-44c9-9ddd-0534f073ee86', 'volume_size': 1} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] creating volume v_6788e361-8ec1-44c9-9ddd-0534f073ee86. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] create volume {'name': 'v_6788e361-8ec1-44c9-9ddd-0534f073ee86', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_23f74317-5acc-43f3-a82f-e0cf596afaaf', 'is_clone': False, 'name': 'v_23f74317-5acc-43f3-a82f-e0cf596afaaf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b067d693-9a65-44a9-bb03-f2c670984bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f74317-5acc-43f3-a82f-e0cf596afaaf', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39034ee2-0aac-4f72-af9b-2941a842e469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume volume-23f74317-5acc-43f3-a82f-e0cf596afaaf (23f74317-5acc-43f3-a82f-e0cf596afaaf): created successfully Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39034ee2-0aac-4f72-af9b-2941a842e469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (3a1f296a-76c2-4278-8c64-e35ce23ebbdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c66a2ca1-9028-465b-b429-ec33c0c310ab tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created volume successfully. Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_91c7b53f-8dbc-4c82-af71-6347c5350642', 'is_clone': False, 'name': 'v_91c7b53f-8dbc-4c82-af71-6347c5350642'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c7946c-5de2-4589-a1cb-55782745ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c7b53f-8dbc-4c82-af71-6347c5350642', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9380567-9e27-4de6-a9a9-77c31ca045ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume volume-91c7b53f-8dbc-4c82-af71-6347c5350642 (91c7b53f-8dbc-4c82-af71-6347c5350642): created successfully Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9380567-9e27-4de6-a9a9-77c31ca045ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (737c07bb-95c0-45c5-bd18-a2db18f08654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-f234551b-6561-4455-b60e-c7002012a132 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created volume successfully. Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_69a10f5a-e384-45e5-9beb-71a608ad10d8', 'is_clone': False, 'name': 'v_69a10f5a-e384-45e5-9beb-71a608ad10d8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e78c973-42f3-4f3a-922b-72de38a110c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a10f5a-e384-45e5-9beb-71a608ad10d8', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cb7930-972c-449f-a281-b769d563c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume volume-69a10f5a-e384-45e5-9beb-71a608ad10d8 (69a10f5a-e384-45e5-9beb-71a608ad10d8): created successfully Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cb7930-972c-449f-a281-b769d563c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (73b5fa52-a6e7-4a1b-8255-3b00c7a00cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-03e6615b-7be8-4aeb-afc1-cd2cf9ea7e6a tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created volume successfully. Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'is_clone': False, 'name': 'v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a617bc2-8d2f-4c7f-935a-48db9046698f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1eb59a0-a3d8-4c2e-a4d6-222ab2334514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=54,cinder:INSERT=7,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume volume-63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 (63a04eda-d0ab-4dba-b7c7-dfdc48a036c8): created successfully Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1eb59a0-a3d8-4c2e-a4d6-222ab2334514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (72a0ffe3-b3b9-4983-b9ec-32aca9415eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-4a482842-278d-4120-99a3-13d865614e5c tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created volume successfully. Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6788e361-8ec1-44c9-9ddd-0534f073ee86', 'is_clone': False, 'name': 'v_6788e361-8ec1-44c9-9ddd-0534f073ee86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca0300a-049d-4d49-a994-d2dc6fd07437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6788e361-8ec1-44c9-9ddd-0534f073ee86', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49e61f8-b856-4489-873e-0571ea74ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Volume volume-6788e361-8ec1-44c9-9ddd-0534f073ee86 (6788e361-8ec1-44c9-9ddd-0534f073ee86): created successfully Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49e61f8-b856-4489-873e-0571ea74ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Flow 'volume_create_manager' (ea0cab1c-2c04-4903-88c7-7a8d8c9f3d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-17f1d6ea-98d7-43fd-811f-1fe814ef01fd tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created volume successfully. Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Acquiring lock "cinder-6788e361-8ec1-44c9-9ddd-0534f073ee86-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-6788e361-8ec1-44c9-9ddd-0534f073ee86-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove_export for volume: 6788e361-8ec1-44c9-9ddd-0534f073ee86. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622998783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6788e361-8ec1-44c9-9ddd-0534f073ee86,launched_at=2023-04-14T02:11:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth='CHAP IotiHFAG 9OCwx8qSRvEcTb',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:03Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:11:04Z,updated_at=2023-04-14T02:11:04Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume v_6788e361-8ec1-44c9-9ddd-0534f073ee86 from target iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86/luns/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86/luns/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86/luns/v_6788e361-8ec1-44c9-9ddd-0534f073ee86'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86/luns/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 because of JDSS resource v_6788e361-8ec1-44c9-9ddd-0534f073ee86 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target: iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 because of JDSS resource iqn.2010-10.org.openstack:6788e361-8ec1-44c9-9ddd-0534f073ee86 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] deleating volume v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get snapshots for volume v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get volume v_6788e361-8ec1-44c9-9ddd-0534f073ee86 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6788e361-8ec1-44c9-9ddd-0534f073ee86', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439672', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111792', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16521020180378578723', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a84264e882d2fd7c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303602688', 'san:volume_id': 'a84264e882d2fd7ce84f36367e17f02fd03f4005', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83786', 'name': 'v_6788e361-8ec1-44c9-9ddd-0534f073ee86', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete volume:v_6788e361-8ec1-44c9-9ddd-0534f073ee86 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6788e361-8ec1-44c9-9ddd-0534f073ee86 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] volume v_6788e361-8ec1-44c9-9ddd-0534f073ee86 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:11:06 user cinder-volume[73579]: DEBUG cinder.quota [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created reservations ['02c21103-f118-49dc-b67b-96c01395f5e4', '57a3431c-88e6-4a0c-9465-30a6cecd34d2', 'b6300eee-8db1-4815-bd5d-f95d34bb84d8', '86dc33c4-7afc-4d80-b398-e668999b33a0'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:11:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:11:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:11:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303660032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.manager [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:11:07 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Deleted volume successfully. Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-9be8706a-438f-4616-895b-63d1c6802593 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-6788e361-8ec1-44c9-9ddd-0534f073ee86-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Acquiring lock "cinder-63a04eda-d0ab-4dba-b7c7-dfdc48a036c8-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.coordination [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-63a04eda-d0ab-4dba-b7c7-dfdc48a036c8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove_export for volume: 63a04eda-d0ab-4dba-b7c7-dfdc48a036c8. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404508738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=63a04eda-d0ab-4dba-b7c7-dfdc48a036c8,launched_at=2023-04-14T02:11:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth='CHAP IfqsCSMB SGxg6LqnJDtdyF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:03Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:11:07Z,updated_at=2023-04-14T02:11:07Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 from target iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8/luns/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8/luns/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8/luns/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8/luns/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 because of JDSS resource v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target: iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 because of JDSS resource iqn.2010-10.org.openstack:63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] deleating volume v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get snapshots for volume v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get volume v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439672', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111787', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8790306224584252409', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f5765bf1bb312c57', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303660032', 'san:volume_id': 'f5765bf1bb312c57eea8ae5ae38620b4a1b67cb0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83776', 'name': 'v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete volume:v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] volume v_63a04eda-d0ab-4dba-b7c7-dfdc48a036c8 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:11:09 user cinder-volume[73579]: DEBUG cinder.quota [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created reservations ['a402f797-f661-4f00-88ed-7c2d4beecfcb', '176fdbc8-f120-4c42-93ec-ebfa8e2c730b', '308e5747-9a3c-4831-805b-8ec69679185c', 'd1d38399-86d1-4816-b840-032a7cd040b7'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:11:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:11:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:11:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303741952', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.manager [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:11:10 user cinder-volume[73579]: INFO cinder.volume.manager [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Deleted volume successfully. Apr 14 02:11:10 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=58,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-469210be-78ce-4252-a1d8-e27c0bddbec5 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-63a04eda-d0ab-4dba-b7c7-dfdc48a036c8-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Acquiring lock "cinder-69a10f5a-e384-45e5-9beb-71a608ad10d8-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.coordination [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-69a10f5a-e384-45e5-9beb-71a608ad10d8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove_export for volume: 69a10f5a-e384-45e5-9beb-71a608ad10d8. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752983038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=69a10f5a-e384-45e5-9beb-71a608ad10d8,launched_at=2023-04-14T02:11:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth='CHAP cJAKUBIg LqCyVn6r4WBFfI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:02Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:11:11Z,updated_at=2023-04-14T02:11:11Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume v_69a10f5a-e384-45e5-9beb-71a608ad10d8 from target iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8/luns/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8/luns/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8/luns/v_69a10f5a-e384-45e5-9beb-71a608ad10d8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8/luns/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 because of JDSS resource v_69a10f5a-e384-45e5-9beb-71a608ad10d8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target: iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 because of JDSS resource iqn.2010-10.org.openstack:69a10f5a-e384-45e5-9beb-71a608ad10d8 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] deleating volume v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get snapshots for volume v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:10 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get volume v_69a10f5a-e384-45e5-9beb-71a608ad10d8 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_69a10f5a-e384-45e5-9beb-71a608ad10d8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439672', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111783', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2732411040148144822', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a0dcf1932543e59a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303741952', 'san:volume_id': 'a0dcf1932543e59a72f241bef2c3fbc257c768b4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83767', 'name': 'v_69a10f5a-e384-45e5-9beb-71a608ad10d8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete volume:v_69a10f5a-e384-45e5-9beb-71a608ad10d8 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69a10f5a-e384-45e5-9beb-71a608ad10d8 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] volume v_69a10f5a-e384-45e5-9beb-71a608ad10d8 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.quota [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created reservations ['3013627b-806d-46c9-b7f3-b6aa656388cc', 'f6b83155-b73b-4208-af0d-15d333c35324', '309d730e-c253-4072-9b1c-779270c5dc80', '30de2294-39b8-4a76-8820-47499c049b41'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303823872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.manager [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:11:13 user cinder-volume[73579]: INFO cinder.volume.manager [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Deleted volume successfully. Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-43f5d1ab-129b-4386-b386-bb3a97158c37 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-69a10f5a-e384-45e5-9beb-71a608ad10d8-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Acquiring lock "cinder-91c7b53f-8dbc-4c82-af71-6347c5350642-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:11:13 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-91c7b53f-8dbc-4c82-af71-6347c5350642-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove_export for volume: 91c7b53f-8dbc-4c82-af71-6347c5350642. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2070077008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=91c7b53f-8dbc-4c82-af71-6347c5350642,launched_at=2023-04-14T02:11:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth='CHAP hawzGBdU wYPbx4VRdgL7K6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:02Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:11:14Z,updated_at=2023-04-14T02:11:14Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume v_91c7b53f-8dbc-4c82-af71-6347c5350642 from target iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642/luns/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642/luns/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642/luns/v_91c7b53f-8dbc-4c82-af71-6347c5350642'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642/luns/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 because of JDSS resource v_91c7b53f-8dbc-4c82-af71-6347c5350642 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target: iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 because of JDSS resource iqn.2010-10.org.openstack:91c7b53f-8dbc-4c82-af71-6347c5350642 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] deleating volume v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get snapshots for volume v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get volume v_91c7b53f-8dbc-4c82-af71-6347c5350642 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_91c7b53f-8dbc-4c82-af71-6347c5350642', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439672', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111780', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8673664723302051046', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c21669e3ee8b8628', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303823872', 'san:volume_id': 'c21669e3ee8b8628c1bdce872147c7b30a3601e7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84199', 'name': 'v_91c7b53f-8dbc-4c82-af71-6347c5350642', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete volume:v_91c7b53f-8dbc-4c82-af71-6347c5350642 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_91c7b53f-8dbc-4c82-af71-6347c5350642 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] volume v_91c7b53f-8dbc-4c82-af71-6347c5350642 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.quota [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created reservations ['7ed07f6b-a400-4a74-b6de-cf89ff54ef97', '1b336661-bb87-4a18-b97b-a48a61bdda9a', '09859713-ad1f-4263-9927-e96b3235f7d2', '4f61a616-f6e2-4cc0-8143-2a2364f593b4'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=54,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=10 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303905792', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.manager [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:11:16 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Deleted volume successfully. Apr 14 02:11:16 user cinder-volume[73579]: DEBUG cinder.coordination [None req-6a3995c5-2886-4f20-8f62-6695dd7ff06f tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-91c7b53f-8dbc-4c82-af71-6347c5350642-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Acquiring lock "cinder-23f74317-5acc-43f3-a82f-e0cf596afaaf-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-23f74317-5acc-43f3-a82f-e0cf596afaaf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove_export for volume: 23f74317-5acc-43f3-a82f-e0cf596afaaf. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570066202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=23f74317-5acc-43f3-a82f-e0cf596afaaf,launched_at=2023-04-14T02:11:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth='CHAP EqAlIbzj 2A6zT8ceM75aXg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:02Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:11:17Z,updated_at=2023-04-14T02:11:17Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume v_23f74317-5acc-43f3-a82f-e0cf596afaaf from target iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf/luns/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf/luns/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf/luns/v_23f74317-5acc-43f3-a82f-e0cf596afaaf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf/luns/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf because of JDSS resource v_23f74317-5acc-43f3-a82f-e0cf596afaaf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target: iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf because of JDSS resource iqn.2010-10.org.openstack:23f74317-5acc-43f3-a82f-e0cf596afaaf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] deleating volume v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get snapshots for volume v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get volume v_23f74317-5acc-43f3-a82f-e0cf596afaaf info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_23f74317-5acc-43f3-a82f-e0cf596afaaf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439671', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111777', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8456876125922869233', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4dd46743b9ab5989', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303905792', 'san:volume_id': '4dd46743b9ab598912341cd85a468bd231c690c0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84191', 'name': 'v_23f74317-5acc-43f3-a82f-e0cf596afaaf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete volume:v_23f74317-5acc-43f3-a82f-e0cf596afaaf recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_23f74317-5acc-43f3-a82f-e0cf596afaaf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] volume v_23f74317-5acc-43f3-a82f-e0cf596afaaf deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Flow 'volume_create_manager' (cf06871b-04a5-4cb8-83cb-9bcb0696de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04106471-d5fc-44e1-8e35-a320034be901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04106471-d5fc-44e1-8e35-a320034be901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-333334561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9f12b47d-8b55-4650-9f88-e50281b67877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:11:20Z,use_quota=True,user_id='19633f8d769c4e50b5e6c9a75497b510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32b84ea-c85d-45c4-958d-6f0fbb132c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32b84ea-c85d-45c4-958d-6f0fbb132c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc52c53-7594-414c-8816-e2301a1da3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc52c53-7594-414c-8816-e2301a1da3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f12b47d-8b55-4650-9f88-e50281b67877', 'volume_name': 'volume-9f12b47d-8b55-4650-9f88-e50281b67877', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19863ee3-3cdb-4b84-a1c5-4565f568a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19863ee3-3cdb-4b84-a1c5-4565f568a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d801bc-3e4c-4668-8a29-015e692c28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:19 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Volume 9f12b47d-8b55-4650-9f88-e50281b67877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f12b47d-8b55-4650-9f88-e50281b67877', 'volume_size': 1} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] creating volume v_9f12b47d-8b55-4650-9f88-e50281b67877. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] create volume {'name': 'v_9f12b47d-8b55-4650-9f88-e50281b67877', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.quota [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created reservations ['fdb0af41-6996-40b5-8061-1b4311c9f829', '2459e520-b72a-4a2e-8261-0ca6d32cca93', '1725f767-1f2d-4cb2-bb40-86e8b2e600f5', '7f1d28b2-bb47-46b4-a134-5de379f4c9a3'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:19 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304000000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.manager [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:11:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Deleted volume successfully. Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-591dcb11-c2dd-4851-8757-cc95d52ce0c0 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-23f74317-5acc-43f3-a82f-e0cf596afaaf-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Acquiring lock "cinder-eebc89a1-e14e-438c-8852-d8b182c70cd2-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9f12b47d-8b55-4650-9f88-e50281b67877', 'is_clone': False, 'name': 'v_9f12b47d-8b55-4650-9f88-e50281b67877'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-eebc89a1-e14e-438c-8852-d8b182c70cd2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d801bc-3e4c-4668-8a29-015e692c28bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f12b47d-8b55-4650-9f88-e50281b67877', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b855fac2-c1db-40c1-b5e8-5a3d1b8b6cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:11:20 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Volume volume-9f12b47d-8b55-4650-9f88-e50281b67877 (9f12b47d-8b55-4650-9f88-e50281b67877): created successfully Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b855fac2-c1db-40c1-b5e8-5a3d1b8b6cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Flow 'volume_create_manager' (cf06871b-04a5-4cb8-83cb-9bcb0696de97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:11:20 user cinder-volume[73579]: INFO cinder.volume.manager [None req-10fa96df-0fd7-473b-84cc-36660d96d652 tempest-TestMinimumBasicScenario-1976287714 None] Created volume successfully. Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove_export for volume: eebc89a1-e14e-438c-8852-d8b182c70cd2. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1793190700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eebc89a1-e14e-438c-8852-d8b182c70cd2,launched_at=2023-04-14T02:11:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e4ba22bf8a415c9f2f36f5d6333323',provider_auth='CHAP KQaRAjoz PKkmeWVFwG9AHu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:01Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:11:21Z,updated_at=2023-04-14T02:11:21Z,use_quota=True,user_id='0f1a2aea5a624e94ace1d73b319cad02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] detach volume v_eebc89a1-e14e-438c-8852-d8b182c70cd2 from target iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2/luns/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2/luns/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2/luns/v_eebc89a1-e14e-438c-8852-d8b182c70cd2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2/luns/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 because of JDSS resource v_eebc89a1-e14e-438c-8852-d8b182c70cd2 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target: iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete target iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] failed to remove resource iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 because of JDSS resource iqn.2010-10.org.openstack:eebc89a1-e14e-438c-8852-d8b182c70cd2 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] deleating volume v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get snapshots for volume v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] get volume v_eebc89a1-e14e-438c-8852-d8b182c70cd2 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eebc89a1-e14e-438c-8852-d8b182c70cd2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439670', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111773', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16681079658891079745', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6ab11e5d28b41894', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303930368', 'san:volume_id': '6ab11e5d28b41894bdbb5d8d33ca5b0bd5bf29ae', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84182', 'name': 'v_eebc89a1-e14e-438c-8852-d8b182c70cd2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] delete volume:v_eebc89a1-e14e-438c-8852-d8b182c70cd2 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] create export for volume: 9f12b47d-8b55-4650-9f88-e50281b67877. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] ensure volume 9f12b47d-8b55-4650-9f88-e50281b67877 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] check if targe iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] create target and attach volume 9f12b47d-8b55-4650-9f88-e50281b67877 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] create target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eebc89a1-e14e-438c-8852-d8b182c70cd2 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] volume v_eebc89a1-e14e-438c-8852-d8b182c70cd2 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.quota [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Created reservations ['49775190-7bf1-4be0-9d19-190e0aa57b7b', 'e66376fd-83d5-487d-9e67-3b4618a1b279', '45d6e385-557c-48e7-a2ea-981c94c56678', '72505f82-fb5e-44c1-a6ca-36032d9a2e36'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:22 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304000000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:11:23 user cinder-volume[73579]: DEBUG cinder.manager [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:11:23 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Deleted volume successfully. Apr 14 02:11:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c883604c-a0aa-4560-8225-1c25d66fc0c4 tempest-CreateVolumesFromSourceVolumeTest-433040280 None] Lock "cinder-eebc89a1-e14e-438c-8852-d8b182c70cd2-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] atach volume v_9f12b47d-8b55-4650-9f88-e50281b67877 to target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:11:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3962633464393162', 'lun': 0, 'mode': 'wt', 'name': 'v_9f12b47d-8b55-4650-9f88-e50281b67877', 'prod_id': 'Storage', 'scsi_id': '9bc4d91b855b5d72'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] add credentails to target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'name': 'xPHDCKoL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=60,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] initialize_connection for 9f12b47d-8b55-4650-9f88-e50281b67877 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:11:26 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '143a641e-673a-4f82-8951-21729a3f8809'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:11:26 user cinder-volume[73579]: INFO cinder.volume.manager [req-427934b0-4a23-4a88-854a-7ad6f2b06935 req-4d1c325e-e7d0-4620-a840-0420d4bf147f tempest-TestMinimumBasicScenario-1976287714 None] attachment_update completed successfully. Apr 14 02:11:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] create snapshot 07972e3c-9e0f-4cbc-ab14-50b8322a2f4e for volume 9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:11:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] cloning v_9f12b47d-8b55-4650-9f88-e50281b67877 to s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:11:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] create snapshot s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:11:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] create volume s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e from snapshot s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:11:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/clone {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9f12b47d-8b55-4650-9f88-e50281b67877@s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e', 'is_clone': True, 'full_name': 'Pool-0/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e', 'name': 's_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/clone {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e/properties {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e/properties {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] volume s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e properties updated {{(pid=73579) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:11:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-b71e4b2a-9ae0-4674-a2ae-736277b37914 tempest-TestMinimumBasicScenario-1976287714 None] Create snapshot completed successfully Apr 14 02:11:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303987712', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:11:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:11:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Acquiring lock "cinder-07972e3c-9e0f-4cbc-ab14-50b8322a2f4e-delete_snapshot" by "delete_snapshot" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:11:35 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Lock "cinder-07972e3c-9e0f-4cbc-ab14-50b8322a2f4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:11:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] deleating snapshot s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e. {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:11:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] get snapshots for volume s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:11:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] get volume s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9f12b47d-8b55-4650-9f88-e50281b67877@s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439699', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111813', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5752948531839186543', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c5a11b7274ff8ef0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303987712', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84572', 'name': 's_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] delete snapshot s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e of volume v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:11:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:11:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots/s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:11:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] snapshot s_07972e3c-9e0f-4cbc-ab14-50b8322a2f4e deleted {{(pid=73579) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:11:37 user cinder-volume[73579]: DEBUG cinder.quota [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Created reservations ['468d52f0-379d-4204-ae68-62a8cf2ed048', 'f0a293e8-53f0-4af7-96bd-280ccbb4d307', '5b05d438-7123-452e-a10d-dd6814878b4e', '8b562778-12ea-4906-8add-391e4e3ff6c9'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:11:37 user cinder-volume[73579]: INFO cinder.volume.manager [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Delete snapshot completed successfully. Apr 14 02:11:37 user cinder-volume[73579]: DEBUG cinder.coordination [None req-5f063b63-cee1-45d3-ba92-7402cbffd4b6 tempest-TestMinimumBasicScenario-1976287714 None] Lock "cinder-07972e3c-9e0f-4cbc-ab14-50b8322a2f4e-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:11:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=55,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=25,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Flow 'volume_create_manager' (803ed833-0fa2-4c48-a9aa-f5f0fcf5ba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c3c01b-c60f-4eb6-b9d6-644458c36080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c3c01b-c60f-4eb6-b9d6-644458c36080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-767870232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=061ecf8a-30b1-466a-8a33-59b6281720bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:12:12Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5679628c-2f25-42e1-9d69-1136efde8164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5679628c-2f25-42e1-9d69-1136efde8164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1c9e53-b129-4a07-b5bc-3619c2e16f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1c9e53-b129-4a07-b5bc-3619c2e16f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061ecf8a-30b1-466a-8a33-59b6281720bf', 'volume_name': 'volume-061ecf8a-30b1-466a-8a33-59b6281720bf', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575fe50d-7ec8-4190-892b-fe011a9b58d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575fe50d-7ec8-4190-892b-fe011a9b58d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84ec416-e48f-4e29-8128-2dfa8a726538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:12:11 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Volume 061ecf8a-30b1-466a-8a33-59b6281720bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061ecf8a-30b1-466a-8a33-59b6281720bf', 'volume_size': 1} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] creating volume v_061ecf8a-30b1-466a-8a33-59b6281720bf. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] create volume {'name': 'v_061ecf8a-30b1-466a-8a33-59b6281720bf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:12:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:12:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_061ecf8a-30b1-466a-8a33-59b6281720bf', 'is_clone': False, 'name': 'v_061ecf8a-30b1-466a-8a33-59b6281720bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:12:12 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84ec416-e48f-4e29-8128-2dfa8a726538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061ecf8a-30b1-466a-8a33-59b6281720bf', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:12:12 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db388f0-fc43-4678-bdb5-d33fbe94bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:12:12 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Volume volume-061ecf8a-30b1-466a-8a33-59b6281720bf (061ecf8a-30b1-466a-8a33-59b6281720bf): created successfully Apr 14 02:12:12 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db388f0-fc43-4678-bdb5-d33fbe94bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:12:12 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Flow 'volume_create_manager' (803ed833-0fa2-4c48-a9aa-f5f0fcf5ba69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:12:12 user cinder-volume[73579]: INFO cinder.volume.manager [None req-9253f188-a270-4b66-8667-03a1870733e2 tempest-AttachVolumeNegativeTest-1854704348 None] Created volume successfully. Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] create export for volume: 061ecf8a-30b1-466a-8a33-59b6281720bf. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] ensure volume 061ecf8a-30b1-466a-8a33-59b6281720bf assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] check if targe iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] create target and attach volume 061ecf8a-30b1-466a-8a33-59b6281720bf to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] create target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:12:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:12:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:12:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] atach volume v_061ecf8a-30b1-466a-8a33-59b6281720bf to target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:12:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:12:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6565366365623838', 'lun': 0, 'mode': 'wt', 'name': 'v_061ecf8a-30b1-466a-8a33-59b6281720bf', 'prod_id': 'Storage', 'scsi_id': 'ee6ceb884d146f14'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] add credentails to target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'name': 'LWGmUfrk'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] initialize_connection for 061ecf8a-30b1-466a-8a33-59b6281720bf 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:12:18 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWGmUfrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a8929e11-86ac-4174-b3d8-da26d40e24e3'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:12:18 user cinder-volume[73579]: INFO cinder.volume.manager [req-4484903e-e380-44a2-98bf-d533cefe1edf req-005d6313-732e-46ff-b7c1-8601c21b09d6 tempest-AttachVolumeNegativeTest-1854704348 None] attachment_update completed successfully. Apr 14 02:12:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:12:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:12:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:12:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:12:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:12:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303905792', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:12:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:12:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:12:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=24,cinder:UPDATE=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:13:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:13:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:13:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:13:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303893504', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] terminate connection for 9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:13:31 user cinder-volume[73579]: INFO cinder.volume.manager [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Terminate volume connection completed successfully. Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Deleting attachment 143a641e-673a-4f82-8951-21729a3f8809. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] remove_export for volume: 9f12b47d-8b55-4650-9f88-e50281b67877. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-333334561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9f12b47d-8b55-4650-9f88-e50281b67877,launched_at=2023-04-14T02:11:21Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',provider_auth='CHAP xPHDCKoL P7pdZLgS5fOXHV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:20Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:13:31Z,use_quota=True,user_id='19633f8d769c4e50b5e6c9a75497b510',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] detach volume v_9f12b47d-8b55-4650-9f88-e50281b67877 from target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:13:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:13:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:13:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] delete target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:13:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] delete target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:13:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:13:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:13:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:13:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 req-ed5631a3-5338-44a6-8375-5fd79171e054 tempest-TestMinimumBasicScenario-1976287714 None] target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:13:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Acquiring lock "cinder-9f12b47d-8b55-4650-9f88-e50281b67877-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Lock "cinder-9f12b47d-8b55-4650-9f88-e50281b67877-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] remove_export for volume: 9f12b47d-8b55-4650-9f88-e50281b67877. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-333334561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9f12b47d-8b55-4650-9f88-e50281b67877,launched_at=2023-04-14T02:11:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',provider_auth='CHAP xPHDCKoL P7pdZLgS5fOXHV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:11:20Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:14:21Z,updated_at=2023-04-14T02:14:21Z,use_quota=True,user_id='19633f8d769c4e50b5e6c9a75497b510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] detach volume v_9f12b47d-8b55-4650-9f88-e50281b67877 from target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns/v_9f12b47d-8b55-4650-9f88-e50281b67877'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877/luns/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] failed to remove resource iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 because of JDSS resource v_9f12b47d-8b55-4650-9f88-e50281b67877 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] delete target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] delete target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] failed to remove resource iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 because of JDSS resource iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] deleating volume v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] get snapshots for volume v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] get volume v_9f12b47d-8b55-4650-9f88-e50281b67877 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9f12b47d-8b55-4650-9f88-e50281b67877', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439689', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111802', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17515028295398808111', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9bc4d91b855b5d72', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303905792', 'san:volume_id': '9bc4d91b855b5d726b66c3ffdef1f398cbcc5fea', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84558', 'name': 'v_9f12b47d-8b55-4650-9f88-e50281b67877', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] delete volume:v_9f12b47d-8b55-4650-9f88-e50281b67877 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:14:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:14:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:14:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] volume v_9f12b47d-8b55-4650-9f88-e50281b67877 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:14:23 user cinder-volume[73579]: DEBUG cinder.quota [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Created reservations ['b9ca664d-4ee0-4487-9f8d-406262a15545', '0846ccb9-2f3c-4cf6-920d-aafa273798c3', 'd0d5569d-954c-4528-8f2c-2b57f9118a40', 'a0d0da51-cd38-4e2c-884c-cc34d6617fa1'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:14:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:14:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:14:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:14:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:14:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303987712', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:14:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:14:24 user cinder-volume[73579]: DEBUG cinder.manager [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:14:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Deleted volume successfully. Apr 14 02:14:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-af6a49ea-b79f-4a79-a329-0686f9af696a tempest-TestMinimumBasicScenario-1976287714 None] Lock "cinder-9f12b47d-8b55-4650-9f88-e50281b67877-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:14:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:14:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:14:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:14:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:14:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:14:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303975424', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:14:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:14:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:14:34 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] terminate connection for 061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:15:08 user cinder-volume[73579]: INFO cinder.volume.manager [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Terminate volume connection completed successfully. Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Deleting attachment a8929e11-86ac-4174-b3d8-da26d40e24e3. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] remove_export for volume: 061ecf8a-30b1-466a-8a33-59b6281720bf. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-767870232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=061ecf8a-30b1-466a-8a33-59b6281720bf,launched_at=2023-04-14T02:12:13Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth='CHAP LWGmUfrk I7ghlo2aEv0sVq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:12:12Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:15:07Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] detach volume v_061ecf8a-30b1-466a-8a33-59b6281720bf from target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] delete target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] delete target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:15:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-adb238e5-b979-472e-9f8e-bd30e07c0489 req-c9a46f79-0579-4f3c-9c9e-3f1a4d59115d tempest-AttachVolumeNegativeTest-1854704348 None] target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:15:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:15:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:15:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:15:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:15:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:15:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303987712', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:15:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:15:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:15:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:16:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:16:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:16:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:16:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:16:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303975424', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:16:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:16:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:16:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Flow 'volume_create_manager' (f02935c2-e512-40a5-ac6e-91b80e748886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe12e9b-55eb-44b5-9f2d-6e8e7446ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe12e9b-55eb-44b5-9f2d-6e8e7446ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2123904956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e519936-e25f-479c-a1c3-f8fcb9f1af51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:17:09Z,use_quota=True,user_id='19633f8d769c4e50b5e6c9a75497b510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f92e31-ee85-4c77-9603-e93369b488ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f92e31-ee85-4c77-9603-e93369b488ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c094ea9-5532-4399-96a5-93c7b8d33e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c094ea9-5532-4399-96a5-93c7b8d33e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'volume_name': 'volume-8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb591c4-b101-4146-982a-761470d7bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb591c4-b101-4146-982a-761470d7bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673fffb9-6905-4cc0-b3cf-7ee163d98a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:17:08 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'volume_size': 1} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] creating volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] create volume {'name': 'v_8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:17:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:17:09 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'is_clone': False, 'name': 'v_8e519936-e25f-479c-a1c3-f8fcb9f1af51'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:17:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673fffb9-6905-4cc0-b3cf-7ee163d98a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:17:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1278db84-229e-471d-b20f-1cd180501251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:17:09 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Volume volume-8e519936-e25f-479c-a1c3-f8fcb9f1af51 (8e519936-e25f-479c-a1c3-f8fcb9f1af51): created successfully Apr 14 02:17:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1278db84-229e-471d-b20f-1cd180501251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:17:09 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Flow 'volume_create_manager' (f02935c2-e512-40a5-ac6e-91b80e748886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:17:09 user cinder-volume[73579]: INFO cinder.volume.manager [None req-47a56955-5164-4bd9-8512-84f95b06005c tempest-TestMinimumBasicScenario-1976287714 None] Created volume successfully. Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] create export for volume: 8e519936-e25f-479c-a1c3-f8fcb9f1af51. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] ensure volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] check if targe iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] create target and attach volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] create target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:17:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:17:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:17:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] atach volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 to target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:17:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:17:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:17:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3935653336653839', 'lun': 0, 'mode': 'wt', 'name': 'v_8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'prod_id': 'Storage', 'scsi_id': '95e36e8965a0451b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:17:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] add credentails to target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:17:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:17:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:17:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 201, 'error': None, 'data': {'name': 'UTcCjGIz'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:17:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] initialize_connection for 8e519936-e25f-479c-a1c3-f8fcb9f1af51 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:17:15 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTcCjGIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '69bb55f3-30e0-4804-9919-ddc2eefff1a6'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:17:16 user cinder-volume[73579]: INFO cinder.volume.manager [req-b4ef0408-9ffc-4d08-86c6-dd698488b35d req-12425558-7a49-4dfd-ace1-824726b08e21 tempest-TestMinimumBasicScenario-1976287714 None] attachment_update completed successfully. Apr 14 02:17:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=5,cinder:SELECT=18,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:17:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:17:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:17:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:17:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:17:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303868928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:17:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:17:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:17:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:18:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:18:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:18:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303868928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:18:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Flow 'volume_create_manager' (70ddcbe5-5691-42ef-8f00-74af25f00b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348a08f3-ffef-4f2f-9e1f-47a86996b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348a08f3-ffef-4f2f-9e1f-47a86996b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-703079426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=de3bdf10-3f9b-49fc-b630-83ff7b711656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:18:43Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39ad79b-c034-4a5a-ac18-9233eb3add12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39ad79b-c034-4a5a-ac18-9233eb3add12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fb318c-52cd-42b9-871c-03435902815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fb318c-52cd-42b9-871c-03435902815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3bdf10-3f9b-49fc-b630-83ff7b711656', 'volume_name': 'volume-de3bdf10-3f9b-49fc-b630-83ff7b711656', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b0983c-5e2b-4d82-87fd-e8bfa55e1c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b0983c-5e2b-4d82-87fd-e8bfa55e1c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f717821f-6058-4a42-986c-0b00401ed0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:18:43 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Volume de3bdf10-3f9b-49fc-b630-83ff7b711656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3bdf10-3f9b-49fc-b630-83ff7b711656', 'volume_size': 1} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] creating volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] create volume {'name': 'v_de3bdf10-3f9b-49fc-b630-83ff7b711656', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:44 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_de3bdf10-3f9b-49fc-b630-83ff7b711656', 'is_clone': False, 'name': 'v_de3bdf10-3f9b-49fc-b630-83ff7b711656'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f717821f-6058-4a42-986c-0b00401ed0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3bdf10-3f9b-49fc-b630-83ff7b711656', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:18:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132ddda2-df12-4ac2-ae42-2a5439cd805e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:18:44 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Volume volume-de3bdf10-3f9b-49fc-b630-83ff7b711656 (de3bdf10-3f9b-49fc-b630-83ff7b711656): created successfully Apr 14 02:18:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132ddda2-df12-4ac2-ae42-2a5439cd805e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:18:44 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Flow 'volume_create_manager' (70ddcbe5-5691-42ef-8f00-74af25f00b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:18:44 user cinder-volume[73579]: INFO cinder.volume.manager [None req-d2e5a4e0-36a2-4da1-95c4-606d9e0dcad1 tempest-AttachVolumeNegativeTest-1854704348 None] Created volume successfully. Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] create export for volume: de3bdf10-3f9b-49fc-b630-83ff7b711656. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] ensure volume de3bdf10-3f9b-49fc-b630-83ff7b711656 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] check if targe iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] create target and attach volume de3bdf10-3f9b-49fc-b630-83ff7b711656 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] create target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:45 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] atach volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656 to target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:18:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:47 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3730653330386135', 'lun': 0, 'mode': 'wt', 'name': 'v_de3bdf10-3f9b-49fc-b630-83ff7b711656', 'prod_id': 'Storage', 'scsi_id': '70e308a5f976ee9a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] add credentails to target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:18:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'name': 'cqFTNOLU'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:49 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] initialize_connection for de3bdf10-3f9b-49fc-b630-83ff7b711656 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:18:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqFTNOLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'fb4e67e5-883d-4b94-8ac6-c75a48d6ef87'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:18:49 user cinder-volume[73579]: INFO cinder.volume.manager [req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 req-8adfa901-2da8-4ec7-867f-9ebee6a9b1bf tempest-AttachVolumeNegativeTest-1854704348 None] attachment_update completed successfully. Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] terminate connection for de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:18:52 user cinder-volume[73579]: INFO cinder.volume.manager [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Terminate volume connection completed successfully. Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Deleting attachment fb4e67e5-883d-4b94-8ac6-c75a48d6ef87. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] remove_export for volume: de3bdf10-3f9b-49fc-b630-83ff7b711656. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-703079426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=de3bdf10-3f9b-49fc-b630-83ff7b711656,launched_at=2023-04-14T02:18:44Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth='CHAP cqFTNOLU yGOTHmK23i9Rjt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:18:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:18:52Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] detach volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656 from target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] delete target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] delete target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:18:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:18:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:18:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d11dff16-8e93-413d-99ec-68bf2e78324d req-60926670-23c3-46e5-83c7-bbf2824cb43a tempest-AttachVolumeNegativeTest-1854704348 None] target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:19:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=20,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] terminate connection for 8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:19:16 user cinder-volume[73579]: INFO cinder.volume.manager [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Terminate volume connection completed successfully. Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Deleting attachment 69bb55f3-30e0-4804-9919-ddc2eefff1a6. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] remove_export for volume: 8e519936-e25f-479c-a1c3-f8fcb9f1af51. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2123904956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e519936-e25f-479c-a1c3-f8fcb9f1af51,launched_at=2023-04-14T02:17:10Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',provider_auth='CHAP UTcCjGIz XbvIlQK7aVkAWZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:17:09Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:19:15Z,use_quota=True,user_id='19633f8d769c4e50b5e6c9a75497b510',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] detach volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 from target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] delete target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] delete target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:19:16 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:19:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:19:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-06f1ead4-077d-4dcf-b536-0d340e8de914 req-2ab4266b-afce-4e52-a634-c89e8e1a4445 tempest-TestMinimumBasicScenario-1976287714 None] target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:19:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:19:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:19:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:19:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:19:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:19:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303787008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:19:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:19:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:19:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Acquiring lock "cinder-8e519936-e25f-479c-a1c3-f8fcb9f1af51-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Lock "cinder-8e519936-e25f-479c-a1c3-f8fcb9f1af51-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] remove_export for volume: 8e519936-e25f-479c-a1c3-f8fcb9f1af51. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2123904956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e519936-e25f-479c-a1c3-f8fcb9f1af51,launched_at=2023-04-14T02:17:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',provider_auth='CHAP UTcCjGIz XbvIlQK7aVkAWZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:17:09Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:20:06Z,updated_at=2023-04-14T02:20:06Z,use_quota=True,user_id='19633f8d769c4e50b5e6c9a75497b510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] detach volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 from target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51/luns/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] failed to remove resource iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 because of JDSS resource v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] delete target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] delete target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] failed to remove resource iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 because of JDSS resource iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] deleating volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] get snapshots for volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:20:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] get volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440038', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111895', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '203896307246089571', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '95e36e8965a0451b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303787008', 'san:volume_id': '95e36e8965a0451b22d329c152a5533778a30b68', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83939', 'name': 'v_8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] delete volume:v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:20:06 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] volume v_8e519936-e25f-479c-a1c3-f8fcb9f1af51 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.quota [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Created reservations ['fb46f458-768e-436f-9c63-5ac5ea3f685a', '160ec2aa-2f92-4745-b255-19a217f08a3b', '32fade73-a788-4a57-ae82-3561704b9b3c', 'fceee2d1-79a1-4f64-beb5-12d077de507c'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303868928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.manager [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:20:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Deleted volume successfully. Apr 14 02:20:08 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e18f1500-d08d-4c96-8bf0-0b8390b90856 tempest-TestMinimumBasicScenario-1976287714 None] Lock "cinder-8e519936-e25f-479c-a1c3-f8fcb9f1af51-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:20:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=19,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:20:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:20:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:20:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:20:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:20:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303868928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:20:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:20:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:20:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:21:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:21:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:21:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:21:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:21:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:21:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:21:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:21:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303868928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:21:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:21:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:21:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:21:46 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:16 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Flow 'volume_create_manager' (c6d5b706-e9f6-48b0-8925-5ceff9e4adb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ede45f-f16d-42ec-b659-ce8b928e4c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ede45f-f16d-42ec-b659-ce8b928e4c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1844642744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=24bbdf6a-5311-490b-bece-4364727d75d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:22:29Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457ee2c1-c5ae-48d2-99f0-146cd608a4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457ee2c1-c5ae-48d2-99f0-146cd608a4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb5a85e-d33e-4836-9e25-df9be3fbd262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb5a85e-d33e-4836-9e25-df9be3fbd262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24bbdf6a-5311-490b-bece-4364727d75d9', 'volume_name': 'volume-24bbdf6a-5311-490b-bece-4364727d75d9', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6a72d7-3792-4364-8fb7-84ce2cb11b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6a72d7-3792-4364-8fb7-84ce2cb11b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d8fb49-5231-41fb-8d04-0a034bbe26d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:22:29 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Volume 24bbdf6a-5311-490b-bece-4364727d75d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24bbdf6a-5311-490b-bece-4364727d75d9', 'volume_size': 1} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] creating volume v_24bbdf6a-5311-490b-bece-4364727d75d9. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] create volume {'name': 'v_24bbdf6a-5311-490b-bece-4364727d75d9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_24bbdf6a-5311-490b-bece-4364727d75d9', 'is_clone': False, 'name': 'v_24bbdf6a-5311-490b-bece-4364727d75d9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d8fb49-5231-41fb-8d04-0a034bbe26d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bbdf6a-5311-490b-bece-4364727d75d9', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd24b114-f6d0-4783-8e55-3cf45598ab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:22:30 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Volume volume-24bbdf6a-5311-490b-bece-4364727d75d9 (24bbdf6a-5311-490b-bece-4364727d75d9): created successfully Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd24b114-f6d0-4783-8e55-3cf45598ab0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Flow 'volume_create_manager' (c6d5b706-e9f6-48b0-8925-5ceff9e4adb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:22:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-dd2eca6f-bb5b-49be-921c-956e9b4078af tempest-AttachVolumeNegativeTest-1854704348 None] Created volume successfully. Apr 14 02:22:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303774720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] create export for volume: 24bbdf6a-5311-490b-bece-4364727d75d9. {{(pid=73579) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] ensure volume 24bbdf6a-5311-490b-bece-4364727d75d9 assigned to a proper target {{(pid=73579) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] check if targe iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 exists {{(pid=73579) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] create target and attach volume 24bbdf6a-5311-490b-bece-4364727d75d9 to it {{(pid=73579) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] create target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] atach volume v_24bbdf6a-5311-490b-bece-4364727d75d9 to target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:22:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:34 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3735343563323133', 'lun': 0, 'mode': 'wt', 'name': 'v_24bbdf6a-5311-490b-bece-4364727d75d9', 'prod_id': 'Storage', 'scsi_id': '7545c21361e9a253'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] add credentails to target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:22:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/incoming-users {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 201, 'error': None, 'data': {'name': 'sxZeHApK'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/incoming-users {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] initialize_connection for 24bbdf6a-5311-490b-bece-4364727d75d9 10.0.0.210. {{(pid=73579) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:22:36 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxZeHApK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e5d8397d-ee20-4bfa-9761-c8d107a2f60e'} {{(pid=73579) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:22:36 user cinder-volume[73579]: INFO cinder.volume.manager [req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a req-761ad9fb-737c-4382-8e36-c79b7d3ef117 tempest-AttachVolumeNegativeTest-1854704348 None] attachment_update completed successfully. Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] terminate connection for 24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:22:40 user cinder-volume[73579]: INFO cinder.volume.manager [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Terminate volume connection completed successfully. Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.manager [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Deleting attachment e5d8397d-ee20-4bfa-9761-c8d107a2f60e. {{(pid=73579) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] remove_export for volume: 24bbdf6a-5311-490b-bece-4364727d75d9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1844642744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=24bbdf6a-5311-490b-bece-4364727d75d9,launched_at=2023-04-14T02:22:30Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth='CHAP sxZeHApK vRAjTyV0wJgUqf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:22:29Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T02:22:39Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=,volume_type=,volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] detach volume v_24bbdf6a-5311-490b-bece-4364727d75d9 from target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] delete target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] delete target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:22:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 req-51f106ee-6c31-4015-97ca-21710f519e00 tempest-AttachVolumeNegativeTest-1854704348 None] target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 deleted {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:22:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:06 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Acquiring lock "cinder-24bbdf6a-5311-490b-bece-4364727d75d9-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Lock "cinder-24bbdf6a-5311-490b-bece-4364727d75d9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] remove_export for volume: 24bbdf6a-5311-490b-bece-4364727d75d9. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1844642744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=24bbdf6a-5311-490b-bece-4364727d75d9,launched_at=2023-04-14T02:22:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth='CHAP sxZeHApK vRAjTyV0wJgUqf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:22:29Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:24:21Z,updated_at=2023-04-14T02:24:21Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] detach volume v_24bbdf6a-5311-490b-bece-4364727d75d9 from target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns/v_24bbdf6a-5311-490b-bece-4364727d75d9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9/luns/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] failed to remove resource iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 because of JDSS resource v_24bbdf6a-5311-490b-bece-4364727d75d9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] delete target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] delete target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] failed to remove resource iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 because of JDSS resource iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] deleating volume v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] get snapshots for volume v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] get volume v_24bbdf6a-5311-490b-bece-4364727d75d9 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_24bbdf6a-5311-490b-bece-4364727d75d9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440359', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111973', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9442303647971551877', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7545c21361e9a253', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303762432', 'san:volume_id': '7545c21361e9a2536bad7c0cbd81bc8325ee0e6f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83950', 'name': 'v_24bbdf6a-5311-490b-bece-4364727d75d9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] delete volume:v_24bbdf6a-5311-490b-bece-4364727d75d9 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_24bbdf6a-5311-490b-bece-4364727d75d9 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] volume v_24bbdf6a-5311-490b-bece-4364727d75d9 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.quota [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Created reservations ['d7897f0e-a8ae-41fc-96c3-f16bb55eee8a', 'e28ba331-c459-4564-b89b-5139ff74c199', 'fe6f4161-c264-415c-851a-528df6664bac', '29a20b44-bc32-4998-80f0-8642f33c5657'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303844352', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.manager [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:24:23 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Deleted volume successfully. Apr 14 02:24:23 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7391cac5-2ebb-43a5-ab74-e7c27052fff9 tempest-AttachVolumeNegativeTest-1854704348 None] Lock "cinder-24bbdf6a-5311-490b-bece-4364727d75d9-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Acquiring lock "cinder-de3bdf10-3f9b-49fc-b630-83ff7b711656-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Lock "cinder-de3bdf10-3f9b-49fc-b630-83ff7b711656-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] remove_export for volume: de3bdf10-3f9b-49fc-b630-83ff7b711656. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-703079426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=de3bdf10-3f9b-49fc-b630-83ff7b711656,launched_at=2023-04-14T02:18:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth='CHAP cqFTNOLU yGOTHmK23i9Rjt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:18:43Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:24:24Z,updated_at=2023-04-14T02:24:24Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] detach volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656 from target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns/v_de3bdf10-3f9b-49fc-b630-83ff7b711656'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656/luns/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] failed to remove resource iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 because of JDSS resource v_de3bdf10-3f9b-49fc-b630-83ff7b711656 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] delete target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] delete target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] failed to remove resource iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 because of JDSS resource iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] deleating volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] get snapshots for volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] get volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_de3bdf10-3f9b-49fc-b630-83ff7b711656', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440133', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111921', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17205388975741106100', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '70e308a5f976ee9a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303844352', 'san:volume_id': '70e308a5f976ee9a9f0fb0824bf57edea6a87538', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82652', 'name': 'v_de3bdf10-3f9b-49fc-b630-83ff7b711656', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] delete volume:v_de3bdf10-3f9b-49fc-b630-83ff7b711656 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_de3bdf10-3f9b-49fc-b630-83ff7b711656 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] volume v_de3bdf10-3f9b-49fc-b630-83ff7b711656 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG cinder.quota [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Created reservations ['79e83ac4-7fe8-49a0-ad29-3d7c41b7f5f8', 'ff91ca63-5718-446d-ba25-e1f1b6576556', '9ca87d2b-9b24-480f-81d5-ea5e47fc3546', '1fa60b4e-94c1-4964-8996-bcc766ad37dd'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=29,cinder:UPDATE=12,cinder:INSERT=4 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303926272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.manager [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:24:27 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Deleted volume successfully. Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c86a7f70-1c4e-4083-897d-09a0ccb4d9ce tempest-AttachVolumeNegativeTest-1854704348 None] Lock "cinder-de3bdf10-3f9b-49fc-b630-83ff7b711656-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Acquiring lock "cinder-061ecf8a-30b1-466a-8a33-59b6281720bf-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.coordination [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Lock "cinder-061ecf8a-30b1-466a-8a33-59b6281720bf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] remove_export for volume: 061ecf8a-30b1-466a-8a33-59b6281720bf. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-767870232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=061ecf8a-30b1-466a-8a33-59b6281720bf,launched_at=2023-04-14T02:12:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',provider_auth='CHAP LWGmUfrk I7ghlo2aEv0sVq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:12:12Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:24:28Z,updated_at=2023-04-14T02:24:28Z,use_quota=True,user_id='168a0142cf984aacb1f087adcaa96468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] detach volume v_061ecf8a-30b1-466a-8a33-59b6281720bf from target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns/v_061ecf8a-30b1-466a-8a33-59b6281720bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf/luns/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] failed to remove resource iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf because of JDSS resource v_061ecf8a-30b1-466a-8a33-59b6281720bf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] delete target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] delete target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] failed to remove resource iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf because of JDSS resource iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] deleating volume v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] get snapshots for volume v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] get volume v_061ecf8a-30b1-466a-8a33-59b6281720bf info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_061ecf8a-30b1-466a-8a33-59b6281720bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681439741', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '111828', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9804113767077008917', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ee6ceb884d146f14', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303926272', 'san:volume_id': 'ee6ceb884d146f1484fb008956883adf22440214', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83800', 'name': 'v_061ecf8a-30b1-466a-8a33-59b6281720bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] delete volume:v_061ecf8a-30b1-466a-8a33-59b6281720bf recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_061ecf8a-30b1-466a-8a33-59b6281720bf {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] volume v_061ecf8a-30b1-466a-8a33-59b6281720bf deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:24:29 user cinder-volume[73579]: DEBUG cinder.quota [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Created reservations ['39a94667-515b-44b7-aea9-15c1fd40fc1c', 'd6545c2a-75f3-4ce8-8900-c76c73af626e', 'c03cf7e7-7e9a-419b-8db4-3d1ab73fd6af', 'bddee7ea-f3d2-4e63-9976-3931480be243'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304008192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.manager [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:24:30 user cinder-volume[73579]: INFO cinder.volume.manager [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Deleted volume successfully. Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.coordination [None req-601b3df1-a469-439d-bc38-f069fa064e92 tempest-AttachVolumeNegativeTest-1854704348 None] Lock "cinder-061ecf8a-30b1-466a-8a33-59b6281720bf-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304008192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:24:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:24:36 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=37,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Flow 'volume_create_manager' (87f15018-48dd-483a-b3ab-3e24baac40fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57994271-14d8-4965-806f-7a6f202dbc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57994271-14d8-4965-806f-7a6f202dbc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1163602935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2401a29e-2ddf-41f4-b7d0-dafb513b0227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a683d6ec7054fbdbf3c74c71b77ec4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:24:38Z,use_quota=True,user_id='6ec44dada7a14e8fa15d43138e50e04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67684fee-0d70-49c6-adb7-bef2cd7a5cc7),volume_type_id=67684fee-0d70-49c6-adb7-bef2cd7a5cc7)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d789ec98-8dd1-428c-94df-c5db699a50fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d789ec98-8dd1-428c-94df-c5db699a50fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0838f82b-0c3e-4a6d-bbbb-288073ccae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0838f82b-0c3e-4a6d-bbbb-288073ccae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'volume_name': 'volume-2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdb488f-7a84-4d0c-9497-25b55e3df583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdb488f-7a84-4d0c-9497-25b55e3df583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f33bda2-77c5-4c2d-bdc5-de7741f84665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:38 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Volume 2401a29e-2ddf-41f4-b7d0-dafb513b0227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'volume_size': 1} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] creating volume v_2401a29e-2ddf-41f4-b7d0-dafb513b0227. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] create volume {'name': 'v_2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:38 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'is_clone': False, 'name': 'v_2401a29e-2ddf-41f4-b7d0-dafb513b0227'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f33bda2-77c5-4c2d-bdc5-de7741f84665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611b35fe-bf20-4074-803e-49b7a6a8ca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:39 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Volume volume-2401a29e-2ddf-41f4-b7d0-dafb513b0227 (2401a29e-2ddf-41f4-b7d0-dafb513b0227): created successfully Apr 14 02:24:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611b35fe-bf20-4074-803e-49b7a6a8ca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:39 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Flow 'volume_create_manager' (87f15018-48dd-483a-b3ab-3e24baac40fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:24:39 user cinder-volume[73579]: INFO cinder.volume.manager [None req-dc21a72d-44c5-40f5-a7fe-59ff693608e1 tempest-VolumeTypesAccessTest-426761159 None] Created volume successfully. Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Acquiring lock "cinder-2401a29e-2ddf-41f4-b7d0-dafb513b0227-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Lock "cinder-2401a29e-2ddf-41f4-b7d0-dafb513b0227-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] remove_export for volume: 2401a29e-2ddf-41f4-b7d0-dafb513b0227. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1163602935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2401a29e-2ddf-41f4-b7d0-dafb513b0227,launched_at=2023-04-14T02:24:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a683d6ec7054fbdbf3c74c71b77ec4d',provider_auth='CHAP TdmeqGvf 5tkJ0TvOZ7rflu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:24:38Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:24:40Z,updated_at=2023-04-14T02:24:40Z,use_quota=True,user_id='6ec44dada7a14e8fa15d43138e50e04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67684fee-0d70-49c6-adb7-bef2cd7a5cc7),volume_type_id=67684fee-0d70-49c6-adb7-bef2cd7a5cc7) from target:iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] detach volume v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 from target iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227/luns/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227/luns/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227/luns/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227/luns/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] failed to remove resource iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 because of JDSS resource v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] delete target: iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] delete target iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] failed to remove resource iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 because of JDSS resource iqn.2010-10.org.openstack:2401a29e-2ddf-41f4-b7d0-dafb513b0227 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] deleating volume v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] get snapshots for volume v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] get volume v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:24:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440487', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112007', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16883245958911152355', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c49030142abbcaee', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303938560', 'san:volume_id': 'c49030142abbcaeea3cb616bfb6e72686fe09ca8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84242', 'name': 'v_2401a29e-2ddf-41f4-b7d0-dafb513b0227', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] delete volume:v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:24:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:41 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] volume v_2401a29e-2ddf-41f4-b7d0-dafb513b0227 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:24:42 user cinder-volume[73579]: WARNING cinder.quota [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1186935686 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1186935686, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:24:42 user cinder-volume[73579]: WARNING cinder.quota [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1186935686 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1186935686, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:24:42 user cinder-volume[73579]: DEBUG cinder.quota [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Created reservations ['140f779a-8033-4299-815d-80364e4812af', '4593effd-9ab4-4804-8041-a85cea42477a', 'e70a3372-7ee2-43a9-a350-a838e23012d5', '671a8712-6210-494a-a3ff-b584dd5bf266'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:24:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:24:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:24:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:24:43 user cinder-volume[73579]: DEBUG cinder.manager [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:24:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Deleted volume successfully. Apr 14 02:24:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-7815eaa6-e4a8-4ee6-b50c-0a0dfa641e78 tempest-VolumeTypesAccessTest-426761159 None] Lock "cinder-2401a29e-2ddf-41f4-b7d0-dafb513b0227-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Flow 'volume_create_manager' (8ff41a2e-0dc4-4d07-9a87-4ee0f3b03aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521fbc05-ea0c-4406-9a88-b2fbb0cf6843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521fbc05-ea0c-4406-9a88-b2fbb0cf6843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1532464853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edf369ac-2065-44e5-8d3b-a72081206e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a0d2ba88704ee884f7badfc4d19ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:24:48Z,use_quota=True,user_id='052e636ea071434b8dbd66b83594b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa05710-f999-46c6-aa57-2d88e5a76941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa05710-f999-46c6-aa57-2d88e5a76941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9a3460-b481-4e09-8525-673a7bb726e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9a3460-b481-4e09-8525-673a7bb726e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf369ac-2065-44e5-8d3b-a72081206e36', 'volume_name': 'volume-edf369ac-2065-44e5-8d3b-a72081206e36', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b5913b-aee6-4b4a-b570-a912fe105759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b5913b-aee6-4b4a-b570-a912fe105759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc88fe6-408e-4fec-a63f-9489cce8c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:48 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Volume edf369ac-2065-44e5-8d3b-a72081206e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf369ac-2065-44e5-8d3b-a72081206e36', 'volume_size': 1} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] creating volume v_edf369ac-2065-44e5-8d3b-a72081206e36. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] create volume {'name': 'v_edf369ac-2065-44e5-8d3b-a72081206e36', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:48 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:49 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_edf369ac-2065-44e5-8d3b-a72081206e36', 'is_clone': False, 'name': 'v_edf369ac-2065-44e5-8d3b-a72081206e36'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc88fe6-408e-4fec-a63f-9489cce8c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf369ac-2065-44e5-8d3b-a72081206e36', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6146ed04-4b89-4f7b-a4e5-a6ee0f1c1dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:49 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Volume volume-edf369ac-2065-44e5-8d3b-a72081206e36 (edf369ac-2065-44e5-8d3b-a72081206e36): created successfully Apr 14 02:24:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6146ed04-4b89-4f7b-a4e5-a6ee0f1c1dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:49 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Flow 'volume_create_manager' (8ff41a2e-0dc4-4d07-9a87-4ee0f3b03aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:24:49 user cinder-volume[73579]: INFO cinder.volume.manager [None req-46902a8c-338e-4cf8-8e21-caa0ff33c9ef tempest-VolumesTransfersTest-1413990366 None] Created volume successfully. Apr 14 02:24:50 user cinder-volume[73579]: INFO cinder.volume.manager [None req-243a1b72-5140-4e89-a055-4def1e48ac33 tempest-VolumesTransfersTest-1651912353 None] Transfer volume completed successfully. Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Acquiring lock "cinder-edf369ac-2065-44e5-8d3b-a72081206e36-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Lock "cinder-edf369ac-2065-44e5-8d3b-a72081206e36-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] remove_export for volume: edf369ac-2065-44e5-8d3b-a72081206e36. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1532464853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edf369ac-2065-44e5-8d3b-a72081206e36,launched_at=2023-04-14T02:24:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b722c362d5bf46d68615953450175bad',provider_auth='CHAP oWjuEOwz 3LFonAZabEVYex',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:24:48Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:24:50Z,updated_at=2023-04-14T02:24:50Z,use_quota=True,user_id='3b71ecf5d3754a57b26b6d81042d097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] detach volume v_edf369ac-2065-44e5-8d3b-a72081206e36 from target iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36/luns/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36/luns/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36/luns/v_edf369ac-2065-44e5-8d3b-a72081206e36'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36/luns/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] failed to remove resource iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 because of JDSS resource v_edf369ac-2065-44e5-8d3b-a72081206e36 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] delete target: iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] delete target iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] failed to remove resource iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 because of JDSS resource iqn.2010-10.org.openstack:edf369ac-2065-44e5-8d3b-a72081206e36 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] deleating volume v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] get snapshots for volume v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:50 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] get volume v_edf369ac-2065-44e5-8d3b-a72081206e36 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_edf369ac-2065-44e5-8d3b-a72081206e36', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440498', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112013', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10148251606950664588', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '04cb812f6a41caae', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303938560', 'san:volume_id': '04cb812f6a41caae1a9f2a6bab0c26b026e7b931', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83825', 'name': 'v_edf369ac-2065-44e5-8d3b-a72081206e36', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] delete volume:v_edf369ac-2065-44e5-8d3b-a72081206e36 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:51 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edf369ac-2065-44e5-8d3b-a72081206e36 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] volume v_edf369ac-2065-44e5-8d3b-a72081206e36 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:24:52 user cinder-volume[73579]: DEBUG cinder.quota [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Created reservations ['91b0a48a-3386-4a83-8ba9-2336e7ab3f67', '35f55016-495c-4b4d-a409-22c376b1a107', 'fcd09a8e-0606-4b78-a5d7-411e75798938', 'f6664741-309a-427e-a49b-a0621150f3ef'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:24:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:24:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:24:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:52 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:53 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:24:53 user cinder-volume[73579]: DEBUG cinder.manager [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:24:53 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Deleted volume successfully. Apr 14 02:24:53 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c1b2c6b5-1ac6-4260-a753-db2d6de20187 tempest-VolumesTransfersTest-871911859 None] Lock "cinder-edf369ac-2065-44e5-8d3b-a72081206e36-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:24:53 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Flow 'volume_create_manager' (688bb981-9818-47b8-b5ba-2e7c26185c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704bff35-110e-4eca-a386-20606b52a552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704bff35-110e-4eca-a386-20606b52a552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1897117418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d4485fe4-e2b1-493f-801f-26f63b8263c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a0d2ba88704ee884f7badfc4d19ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:24:54Z,use_quota=True,user_id='052e636ea071434b8dbd66b83594b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ba15ba-9c46-47e1-8db3-fafff93ae520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ba15ba-9c46-47e1-8db3-fafff93ae520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8abcf2-5132-4f10-b47c-e20631410af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8abcf2-5132-4f10-b47c-e20631410af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4485fe4-e2b1-493f-801f-26f63b8263c6', 'volume_name': 'volume-d4485fe4-e2b1-493f-801f-26f63b8263c6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf1a07c-5aa6-4582-a031-0cd2eda253de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf1a07c-5aa6-4582-a031-0cd2eda253de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421fd410-3427-4dbb-9c03-5517cfc364fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:54 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Volume d4485fe4-e2b1-493f-801f-26f63b8263c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4485fe4-e2b1-493f-801f-26f63b8263c6', 'volume_size': 1} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] creating volume v_d4485fe4-e2b1-493f-801f-26f63b8263c6. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] create volume {'name': 'v_d4485fe4-e2b1-493f-801f-26f63b8263c6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d4485fe4-e2b1-493f-801f-26f63b8263c6', 'is_clone': False, 'name': 'v_d4485fe4-e2b1-493f-801f-26f63b8263c6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421fd410-3427-4dbb-9c03-5517cfc364fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4485fe4-e2b1-493f-801f-26f63b8263c6', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76799e7d-270a-43db-a2e8-632ef2437cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:24:54 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Volume volume-d4485fe4-e2b1-493f-801f-26f63b8263c6 (d4485fe4-e2b1-493f-801f-26f63b8263c6): created successfully Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76799e7d-270a-43db-a2e8-632ef2437cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:24:54 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Flow 'volume_create_manager' (688bb981-9818-47b8-b5ba-2e7c26185c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:24:54 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ac93116e-62fd-45d7-ac3e-5bcbd83868fc tempest-VolumesTransfersTest-1413990366 None] Created volume successfully. Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.coordination [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Acquiring lock "cinder-d4485fe4-e2b1-493f-801f-26f63b8263c6-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.coordination [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Lock "cinder-d4485fe4-e2b1-493f-801f-26f63b8263c6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] remove_export for volume: d4485fe4-e2b1-493f-801f-26f63b8263c6. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1897117418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d4485fe4-e2b1-493f-801f-26f63b8263c6,launched_at=2023-04-14T02:24:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a0d2ba88704ee884f7badfc4d19ffc',provider_auth='CHAP RfkypXxC LyTHf82pEWn651',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:24:54Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:24:55Z,updated_at=2023-04-14T02:24:55Z,use_quota=True,user_id='052e636ea071434b8dbd66b83594b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] detach volume v_d4485fe4-e2b1-493f-801f-26f63b8263c6 from target iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6/luns/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6/luns/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6/luns/v_d4485fe4-e2b1-493f-801f-26f63b8263c6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6/luns/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] failed to remove resource iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 because of JDSS resource v_d4485fe4-e2b1-493f-801f-26f63b8263c6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] delete target: iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] delete target iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] failed to remove resource iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 because of JDSS resource iqn.2010-10.org.openstack:d4485fe4-e2b1-493f-801f-26f63b8263c6 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] deleating volume v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] get snapshots for volume v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] get volume v_d4485fe4-e2b1-493f-801f-26f63b8263c6 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d4485fe4-e2b1-493f-801f-26f63b8263c6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440503', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112018', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15924345092555870002', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a03bac01c44624d2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303926272', 'san:volume_id': 'a03bac01c44624d2d61ce208e307d0fd4e2d8d91', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83836', 'name': 'v_d4485fe4-e2b1-493f-801f-26f63b8263c6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] delete volume:v_d4485fe4-e2b1-493f-801f-26f63b8263c6 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:55 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4485fe4-e2b1-493f-801f-26f63b8263c6 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] volume v_d4485fe4-e2b1-493f-801f-26f63b8263c6 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=34,cinder:SELECT=60,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG cinder.quota [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Created reservations ['dbcb2239-87a0-4eb3-a329-438ca141bab2', 'f6139bfe-0e34-44f4-9ec3-ba043ff57d85', '7ae2203f-c379-42af-b6c2-e120137d55cb', 'b9f9739e-ce4c-44c8-bf51-0fc7e069e780'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:24:57 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:24:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304008192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:24:58 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:24:58 user cinder-volume[73579]: DEBUG cinder.manager [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:24:58 user cinder-volume[73579]: INFO cinder.volume.manager [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Deleted volume successfully. Apr 14 02:24:58 user cinder-volume[73579]: DEBUG cinder.coordination [None req-68c2fb16-fef5-4167-b46e-8303f6b3b296 tempest-VolumesTransfersTest-871911859 None] Lock "cinder-d4485fe4-e2b1-493f-801f-26f63b8263c6-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Flow 'volume_create_manager' (3afd997a-abc1-4fc2-a8e0-865de3e92df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf8d830-5f18-4437-ad62-441c552271fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf8d830-5f18-4437-ad62-441c552271fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-508925572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=99137245-a369-4cc8-9dd4-15b2725e6314,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9dfeb713c8184180a9507ca2e9a4e27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:02Z,use_quota=True,user_id='a75359ff514343a49b4b184cf23c5a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367b11b6-7f9d-472a-a9f2-02d7d2f35c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367b11b6-7f9d-472a-a9f2-02d7d2f35c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca4462f-6896-4f7a-a5d4-2c4c69a16c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca4462f-6896-4f7a-a5d4-2c4c69a16c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99137245-a369-4cc8-9dd4-15b2725e6314', 'volume_name': 'volume-99137245-a369-4cc8-9dd4-15b2725e6314', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78e8a5f-24ea-4f33-8145-19bca7028b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78e8a5f-24ea-4f33-8145-19bca7028b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ceb020-a865-4c83-b326-fe75acf317f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:02 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Volume 99137245-a369-4cc8-9dd4-15b2725e6314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99137245-a369-4cc8-9dd4-15b2725e6314', 'volume_size': 1} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] creating volume v_99137245-a369-4cc8-9dd4-15b2725e6314. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] create volume {'name': 'v_99137245-a369-4cc8-9dd4-15b2725e6314', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:02 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:03 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_99137245-a369-4cc8-9dd4-15b2725e6314', 'is_clone': False, 'name': 'v_99137245-a369-4cc8-9dd4-15b2725e6314'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ceb020-a865-4c83-b326-fe75acf317f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99137245-a369-4cc8-9dd4-15b2725e6314', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336668f2-6ff3-4824-ae67-8a2dde11c9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:03 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Volume volume-99137245-a369-4cc8-9dd4-15b2725e6314 (99137245-a369-4cc8-9dd4-15b2725e6314): created successfully Apr 14 02:25:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336668f2-6ff3-4824-ae67-8a2dde11c9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:03 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Flow 'volume_create_manager' (3afd997a-abc1-4fc2-a8e0-865de3e92df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:03 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=54,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:25:03 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c178cdf3-33b6-4067-a3d1-1e3b4b8f4980 tempest-VolumesListTestJSON-1089380510 None] Created volume successfully. Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Flow 'volume_create_manager' (3fffd9b8-68ee-40f6-b8f9-c5240835b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742961c6-320a-4aa6-b002-4461c5691e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742961c6-320a-4aa6-b002-4461c5691e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1805900141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8a201dd0-18cd-46ec-a3bc-03ff75b2c952,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9dfeb713c8184180a9507ca2e9a4e27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:05Z,use_quota=True,user_id='a75359ff514343a49b4b184cf23c5a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027760fe-34e2-4ccd-a635-95e1f4ad51ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027760fe-34e2-4ccd-a635-95e1f4ad51ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943b0001-2615-4ab2-b246-f4b7f84012ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943b0001-2615-4ab2-b246-f4b7f84012ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'volume_name': 'volume-8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0121c29b-d5fe-46ed-9e55-eb723ef23269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0121c29b-d5fe-46ed-9e55-eb723ef23269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03d633d-8500-455f-b46a-682467051eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:04 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Volume 8a201dd0-18cd-46ec-a3bc-03ff75b2c952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'volume_size': 1} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] creating volume v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] create volume {'name': 'v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:04 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:05 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'is_clone': False, 'name': 'v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03d633d-8500-455f-b46a-682467051eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255a83d9-d615-4cee-acb7-f1fa060a388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:05 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Volume volume-8a201dd0-18cd-46ec-a3bc-03ff75b2c952 (8a201dd0-18cd-46ec-a3bc-03ff75b2c952): created successfully Apr 14 02:25:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255a83d9-d615-4cee-acb7-f1fa060a388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:05 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Flow 'volume_create_manager' (3fffd9b8-68ee-40f6-b8f9-c5240835b771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:05 user cinder-volume[73579]: INFO cinder.volume.manager [None req-915bc6fb-6cb2-414b-9a07-06aa9c717d87 tempest-VolumesListTestJSON-1089380510 None] Created volume successfully. Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Flow 'volume_create_manager' (2200cd44-088d-4141-befc-6fbd33efa2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9d19cb-b149-4308-8e6d-49b1aac3dc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9d19cb-b149-4308-8e6d-49b1aac3dc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2074584450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c6da781c-4112-4be9-95c3-483fed8a65ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9dfeb713c8184180a9507ca2e9a4e27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:07Z,use_quota=True,user_id='a75359ff514343a49b4b184cf23c5a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829c33f6-4338-49e8-90f8-f5af8cfbac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829c33f6-4338-49e8-90f8-f5af8cfbac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa40f64-9b5e-43d8-af11-70094a602315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa40f64-9b5e-43d8-af11-70094a602315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6da781c-4112-4be9-95c3-483fed8a65ef', 'volume_name': 'volume-c6da781c-4112-4be9-95c3-483fed8a65ef', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc712cd1-5a0a-414a-8131-2ab3b0df066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc712cd1-5a0a-414a-8131-2ab3b0df066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb01469-f2ae-4992-a209-47f360a227f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:07 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Volume c6da781c-4112-4be9-95c3-483fed8a65ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6da781c-4112-4be9-95c3-483fed8a65ef', 'volume_size': 1} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] creating volume v_c6da781c-4112-4be9-95c3-483fed8a65ef. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] create volume {'name': 'v_c6da781c-4112-4be9-95c3-483fed8a65ef', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:07 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:08 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c6da781c-4112-4be9-95c3-483fed8a65ef', 'is_clone': False, 'name': 'v_c6da781c-4112-4be9-95c3-483fed8a65ef'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb01469-f2ae-4992-a209-47f360a227f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6da781c-4112-4be9-95c3-483fed8a65ef', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484146f3-7879-44ee-86f2-e218ab42ea7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:08 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Volume volume-c6da781c-4112-4be9-95c3-483fed8a65ef (c6da781c-4112-4be9-95c3-483fed8a65ef): created successfully Apr 14 02:25:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484146f3-7879-44ee-86f2-e218ab42ea7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:08 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Flow 'volume_create_manager' (2200cd44-088d-4141-befc-6fbd33efa2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:08 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e96b9c4d-987c-4cae-b4c9-d64a85aa09d0 tempest-VolumesListTestJSON-1089380510 None] Created volume successfully. Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Acquiring lock "cinder-c6da781c-4112-4be9-95c3-483fed8a65ef-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Lock "cinder-c6da781c-4112-4be9-95c3-483fed8a65ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] remove_export for volume: c6da781c-4112-4be9-95c3-483fed8a65ef. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2074584450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c6da781c-4112-4be9-95c3-483fed8a65ef,launched_at=2023-04-14T02:25:08Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9dfeb713c8184180a9507ca2e9a4e27e',provider_auth='CHAP BtoXGyMh gatjzeRUAdZrp9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:07Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:12Z,updated_at=2023-04-14T02:25:12Z,use_quota=True,user_id='a75359ff514343a49b4b184cf23c5a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] detach volume v_c6da781c-4112-4be9-95c3-483fed8a65ef from target iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef/luns/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef/luns/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef/luns/v_c6da781c-4112-4be9-95c3-483fed8a65ef'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef/luns/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] failed to remove resource iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef because of JDSS resource v_c6da781c-4112-4be9-95c3-483fed8a65ef DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] delete target: iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] delete target iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] failed to remove resource iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef because of JDSS resource iqn.2010-10.org.openstack:c6da781c-4112-4be9-95c3-483fed8a65ef DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] deleating volume v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] get snapshots for volume v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:11 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] get volume v_c6da781c-4112-4be9-95c3-483fed8a65ef info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c6da781c-4112-4be9-95c3-483fed8a65ef', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440516', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112032', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '491371466415687060', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd5bbe4ffd69d2dfe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303787008', 'san:volume_id': 'd5bbe4ffd69d2dfe9ab9cb5addb1f945c595d3c4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84750', 'name': 'v_c6da781c-4112-4be9-95c3-483fed8a65ef', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] delete volume:v_c6da781c-4112-4be9-95c3-483fed8a65ef recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:12 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6da781c-4112-4be9-95c3-483fed8a65ef {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] volume v_c6da781c-4112-4be9-95c3-483fed8a65ef deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:13 user cinder-volume[73579]: DEBUG cinder.quota [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Created reservations ['d1d1a491-8127-4c3b-830b-c6f87be8c13c', 'f547adaf-1fe9-41c0-816a-d6a159fe9a26', '7a996e48-419a-4ef8-bedd-d4f91a9678c4', '957389bd-df48-4cf4-9800-3b49cb812abc'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:13 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303868928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:14 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:14 user cinder-volume[73579]: DEBUG cinder.manager [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:14 user cinder-volume[73579]: INFO cinder.volume.manager [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Deleted volume successfully. Apr 14 02:25:14 user cinder-volume[73579]: DEBUG cinder.coordination [None req-1119a1d8-abfc-465f-8439-98da828edebd tempest-VolumesListTestJSON-1089380510 None] Lock "cinder-c6da781c-4112-4be9-95c3-483fed8a65ef-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:14 user cinder-volume[73579]: DEBUG cinder.coordination [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Acquiring lock "cinder-8a201dd0-18cd-46ec-a3bc-03ff75b2c952-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:14 user cinder-volume[73579]: DEBUG cinder.coordination [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Lock "cinder-8a201dd0-18cd-46ec-a3bc-03ff75b2c952-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] remove_export for volume: 8a201dd0-18cd-46ec-a3bc-03ff75b2c952. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1805900141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8a201dd0-18cd-46ec-a3bc-03ff75b2c952,launched_at=2023-04-14T02:25:06Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9dfeb713c8184180a9507ca2e9a4e27e',provider_auth='CHAP dQsMByzq FgZynG2YR4Jrou',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:05Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:15Z,updated_at=2023-04-14T02:25:15Z,use_quota=True,user_id='a75359ff514343a49b4b184cf23c5a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] detach volume v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 from target iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952/luns/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952/luns/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952/luns/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952/luns/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] failed to remove resource iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 because of JDSS resource v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] delete target: iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] delete target iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] failed to remove resource iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 because of JDSS resource iqn.2010-10.org.openstack:8a201dd0-18cd-46ec-a3bc-03ff75b2c952 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] deleating volume v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] get snapshots for volume v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] get volume v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440514', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112028', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15731957045913123798', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ad777498084de4a7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303868928', 'san:volume_id': 'ad777498084de4a7dfa63c5201f96fefab60a0c4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82662', 'name': 'v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] delete volume:v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:15 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] volume v_8a201dd0-18cd-46ec-a3bc-03ff75b2c952 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.quota [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Created reservations ['3fa0fce2-8653-41be-9256-f5c6b00f88b2', '119e0912-c44a-44aa-bbfa-a643b73270e5', 'e293efa9-52d6-4885-853e-51ec3bf5b970', '2fae91c1-1318-4a30-b2e4-1adcc27456ff'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303950848', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.manager [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:17 user cinder-volume[73579]: INFO cinder.volume.manager [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Deleted volume successfully. Apr 14 02:25:17 user cinder-volume[73579]: DEBUG cinder.coordination [None req-07516792-764d-4487-80df-17d0f92e911e tempest-VolumesListTestJSON-1089380510 None] Lock "cinder-8a201dd0-18cd-46ec-a3bc-03ff75b2c952-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Acquiring lock "cinder-99137245-a369-4cc8-9dd4-15b2725e6314-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Lock "cinder-99137245-a369-4cc8-9dd4-15b2725e6314-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] remove_export for volume: 99137245-a369-4cc8-9dd4-15b2725e6314. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-508925572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=99137245-a369-4cc8-9dd4-15b2725e6314,launched_at=2023-04-14T02:25:03Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9dfeb713c8184180a9507ca2e9a4e27e',provider_auth='CHAP QzyASkmt rvybwU8tGoNdfQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:02Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:18Z,updated_at=2023-04-14T02:25:18Z,use_quota=True,user_id='a75359ff514343a49b4b184cf23c5a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] detach volume v_99137245-a369-4cc8-9dd4-15b2725e6314 from target iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314/luns/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314/luns/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314/luns/v_99137245-a369-4cc8-9dd4-15b2725e6314'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314/luns/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] failed to remove resource iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 because of JDSS resource v_99137245-a369-4cc8-9dd4-15b2725e6314 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] delete target: iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] delete target iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] failed to remove resource iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 because of JDSS resource iqn.2010-10.org.openstack:99137245-a369-4cc8-9dd4-15b2725e6314 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] deleating volume v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] get snapshots for volume v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] get volume v_99137245-a369-4cc8-9dd4-15b2725e6314 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_99137245-a369-4cc8-9dd4-15b2725e6314', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440511', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112024', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3263769394801487792', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0e2665bedcb9d26d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303950848', 'san:volume_id': '0e2665bedcb9d26d3f99557a9c7bf149614f8a3c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84743', 'name': 'v_99137245-a369-4cc8-9dd4-15b2725e6314', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] delete volume:v_99137245-a369-4cc8-9dd4-15b2725e6314 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:18 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_99137245-a369-4cc8-9dd4-15b2725e6314 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] volume v_99137245-a369-4cc8-9dd4-15b2725e6314 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG cinder.quota [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Created reservations ['d0217840-880b-4c5c-8e2e-ff2ba0fa004b', 'c7386dd0-9f34-4995-a241-3c8dc8b76aca', '72fe7237-b2d6-47ff-9fc1-d4a0e0157e2d', '1964f4bc-51e3-48e5-b2a8-628cfd19e452'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=58,cinder:INSERT=4,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:20 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:21 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:21 user cinder-volume[73579]: DEBUG cinder.manager [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:21 user cinder-volume[73579]: INFO cinder.volume.manager [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Deleted volume successfully. Apr 14 02:25:21 user cinder-volume[73579]: DEBUG cinder.coordination [None req-e22bafb8-4b10-4ef1-adfa-aaf86c825f34 tempest-VolumesListTestJSON-1089380510 None] Lock "cinder-99137245-a369-4cc8-9dd4-15b2725e6314-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (0a24a65a-bd5f-45ec-8151-1017acd04ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93c106d-fa9a-4dc4-9660-0af85a3257d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93c106d-fa9a-4dc4-9660-0af85a3257d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484741789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3fda4485-897a-404c-8d9a-77a86738cc81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:23Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b210a38a-bc3c-4a1c-8936-fea5c9f23027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b210a38a-bc3c-4a1c-8936-fea5c9f23027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938c2009-6f60-4496-9582-7ff1ce881250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938c2009-6f60-4496-9582-7ff1ce881250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fda4485-897a-404c-8d9a-77a86738cc81', 'volume_name': 'volume-3fda4485-897a-404c-8d9a-77a86738cc81', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea6a51d-c0d0-4a02-a860-6bc86c1ff4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea6a51d-c0d0-4a02-a860-6bc86c1ff4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9df3b9-d459-47e5-ad33-44a3bbe19520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Volume 3fda4485-897a-404c-8d9a-77a86738cc81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fda4485-897a-404c-8d9a-77a86738cc81', 'volume_size': 1} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] creating volume v_3fda4485-897a-404c-8d9a-77a86738cc81. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] create volume {'name': 'v_3fda4485-897a-404c-8d9a-77a86738cc81', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=55,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=9 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (aa0500aa-7fa7-45ee-b3ec-fa8bbef0bb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79d3784-8db7-4dde-ac70-e05890689489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79d3784-8db7-4dde-ac70-e05890689489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515598514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e752131b-8567-4094-a1e6-59772475cb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:24Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6d39eb-c139-4880-a9fb-ca8540dcb5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6d39eb-c139-4880-a9fb-ca8540dcb5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250685d7-cfda-4f67-97b9-88045e4bc422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250685d7-cfda-4f67-97b9-88045e4bc422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e752131b-8567-4094-a1e6-59772475cb28', 'volume_name': 'volume-e752131b-8567-4094-a1e6-59772475cb28', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c1823f-d227-4092-89f2-7d0ff7444139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c1823f-d227-4092-89f2-7d0ff7444139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d01216-2b81-4d98-86cd-2b69b1d3b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Volume e752131b-8567-4094-a1e6-59772475cb28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e752131b-8567-4094-a1e6-59772475cb28', 'volume_size': 1} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] creating volume v_e752131b-8567-4094-a1e6-59772475cb28. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] create volume {'name': 'v_e752131b-8567-4094-a1e6-59772475cb28', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (625d1010-9554-4ba1-b2c2-4054fdc0a273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa69d159-1c5f-49aa-b3ee-29ed6a7a557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa69d159-1c5f-49aa-b3ee-29ed6a7a557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098207538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=68e68ec9-98ae-4b54-a995-f5a5f5d9f948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:24Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf27b16-b0c4-4b41-9874-d4f021fbb670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf27b16-b0c4-4b41-9874-d4f021fbb670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f82dade-e8e5-4a8c-9bd6-5160282dafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f82dade-e8e5-4a8c-9bd6-5160282dafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'volume_name': 'volume-68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a4b3f2-72bf-4ba6-8e82-af96333be7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a4b3f2-72bf-4ba6-8e82-af96333be7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6944a4d5-39be-4981-b76e-3ae003db4932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:23 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Volume 68e68ec9-98ae-4b54-a995-f5a5f5d9f948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'volume_size': 1} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] creating volume v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] create volume {'name': 'v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:23 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (98ea15e7-af0a-4339-a6ed-dda10139fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554217d0-d9b6-4139-9a5f-a3421594ea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554217d0-d9b6-4139-9a5f-a3421594ea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660293610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=29c1fac7-6099-4519-87ed-d52646075431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:24Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d651cee-420f-4b8e-80e9-82d739a18d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d651cee-420f-4b8e-80e9-82d739a18d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf26c3a0-a55c-4582-a392-8f8242f91bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf26c3a0-a55c-4582-a392-8f8242f91bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c1fac7-6099-4519-87ed-d52646075431', 'volume_name': 'volume-29c1fac7-6099-4519-87ed-d52646075431', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d23af81-02d2-4cbc-a79f-ea7d93f14216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d23af81-02d2-4cbc-a79f-ea7d93f14216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b22c904-bd05-45c8-b3bd-d0cd9bfff36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Volume 29c1fac7-6099-4519-87ed-d52646075431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c1fac7-6099-4519-87ed-d52646075431', 'volume_size': 1} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] creating volume v_29c1fac7-6099-4519-87ed-d52646075431. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] create volume {'name': 'v_29c1fac7-6099-4519-87ed-d52646075431', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3fda4485-897a-404c-8d9a-77a86738cc81', 'is_clone': False, 'name': 'v_3fda4485-897a-404c-8d9a-77a86738cc81'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73579) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (73c15176-661b-4e8d-8ac2-5d962e59341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37a083b-44c9-4930-9361-e737537850d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9df3b9-d459-47e5-ad33-44a3bbe19520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fda4485-897a-404c-8d9a-77a86738cc81', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed50ab8-27d7-4301-b8d6-05d4579026c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37a083b-44c9-4930-9361-e737537850d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012828086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4b0b2c0c-f947-4182-9565-1ed37f93eb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:25:24Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e)' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec477bc-7366-4d88-97f5-c731b1233cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec477bc-7366-4d88-97f5-c731b1233cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdbd2c8-f8c4-463d-a3c7-25507b42cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdbd2c8-f8c4-463d-a3c7-25507b42cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'volume_name': 'volume-4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218c5a9b-0191-45f6-a183-0b701d52e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218c5a9b-0191-45f6-a183-0b701d52e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda6ddc0-ed56-49e5-b942-1b54d8edfaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Volume 4b0b2c0c-f947-4182-9565-1ed37f93eb71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'volume_size': 1} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] creating volume v_4b0b2c0c-f947-4182-9565-1ed37f93eb71. {{(pid=73579) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] create volume {'name': 'v_4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73579) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Volume volume-3fda4485-897a-404c-8d9a-77a86738cc81 (3fda4485-897a-404c-8d9a-77a86738cc81): created successfully Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed50ab8-27d7-4301-b8d6-05d4579026c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (0a24a65a-bd5f-45ec-8151-1017acd04ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-83bb7225-f8d1-440e-86c0-4e5edd6e6b50 tempest-CreateVolumesFromImageTest-165303211 None] Created volume successfully. Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e752131b-8567-4094-a1e6-59772475cb28', 'is_clone': False, 'name': 'v_e752131b-8567-4094-a1e6-59772475cb28'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d01216-2b81-4d98-86cd-2b69b1d3b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e752131b-8567-4094-a1e6-59772475cb28', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6efca4-afd7-4cdb-a635-c4ecbdf20131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'is_clone': False, 'name': 'v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Volume volume-e752131b-8567-4094-a1e6-59772475cb28 (e752131b-8567-4094-a1e6-59772475cb28): created successfully Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6efca4-afd7-4cdb-a635-c4ecbdf20131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (aa0500aa-7fa7-45ee-b3ec-fa8bbef0bb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6944a4d5-39be-4981-b76e-3ae003db4932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448f9734-4339-4a4d-8084-24cb0bc13298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-acdcab02-a982-4b2e-9e19-e50c2142215f tempest-CreateVolumesFromImageTest-165303211 None] Created volume successfully. Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Volume volume-68e68ec9-98ae-4b54-a995-f5a5f5d9f948 (68e68ec9-98ae-4b54-a995-f5a5f5d9f948): created successfully Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448f9734-4339-4a4d-8084-24cb0bc13298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:24 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (625d1010-9554-4ba1-b2c2-4054fdc0a273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:24 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ebb36b94-c9e4-4acd-b240-b9f58d9a7719 tempest-CreateVolumesFromImageTest-165303211 None] Created volume successfully. Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'is_clone': False, 'name': 'v_4b0b2c0c-f947-4182-9565-1ed37f93eb71'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda6ddc0-ed56-49e5-b942-1b54d8edfaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f96de6-9736-4a83-8727-c18330932a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:25 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Volume volume-4b0b2c0c-f947-4182-9565-1ed37f93eb71 (4b0b2c0c-f947-4182-9565-1ed37f93eb71): created successfully Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f96de6-9736-4a83-8727-c18330932a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (73c15176-661b-4e8d-8ac2-5d962e59341d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-6a1a361a-d4a1-48f6-b058-047574b03b7f tempest-CreateVolumesFromImageTest-165303211 None] Created volume successfully. Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_29c1fac7-6099-4519-87ed-d52646075431', 'is_clone': False, 'name': 'v_29c1fac7-6099-4519-87ed-d52646075431'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b22c904-bd05-45c8-b3bd-d0cd9bfff36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c1fac7-6099-4519-87ed-d52646075431', 'volume_size': 1}' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee81c7-7fef-4683-bcc2-1c646c146a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:25:25 user cinder-volume[73579]: INFO cinder.volume.flows.manager.create_volume [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Volume volume-29c1fac7-6099-4519-87ed-d52646075431 (29c1fac7-6099-4519-87ed-d52646075431): created successfully Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee81c7-7fef-4683-bcc2-1c646c146a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73579) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:25:25 user cinder-volume[73579]: DEBUG cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Flow 'volume_create_manager' (98ea15e7-af0a-4339-a6ed-dda10139fbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73579) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:25:25 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ffb2a613-0ffa-42c2-a089-6acb2eebf8da tempest-CreateVolumesFromImageTest-165303211 None] Created volume successfully. Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Acquiring lock "cinder-4b0b2c0c-f947-4182-9565-1ed37f93eb71-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-4b0b2c0c-f947-4182-9565-1ed37f93eb71-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] remove_export for volume: 4b0b2c0c-f947-4182-9565-1ed37f93eb71. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012828086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4b0b2c0c-f947-4182-9565-1ed37f93eb71,launched_at=2023-04-14T02:25:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth='CHAP ZjyLAYsO plx9DYIFAgGhok',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:27Z,updated_at=2023-04-14T02:25:27Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] detach volume v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 from target iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71/luns/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71/luns/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71/luns/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71/luns/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 because of JDSS resource v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] delete target: iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] delete target iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 because of JDSS resource iqn.2010-10.org.openstack:4b0b2c0c-f947-4182-9565-1ed37f93eb71 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] deleating volume v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] get snapshots for volume v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:26 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] get volume v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440534', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112050', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13986340302258492597', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3263e13aba9c7637', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303610880', 'san:volume_id': '3263e13aba9c76376ae2b88c25a91abc12476450', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84211', 'name': 'v_4b0b2c0c-f947-4182-9565-1ed37f93eb71', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] delete volume:v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:27 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:28 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] volume v_4b0b2c0c-f947-4182-9565-1ed37f93eb71 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:28 user cinder-volume[73579]: DEBUG cinder.quota [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Created reservations ['1a568246-e76e-4026-9f71-bda191f171cb', '23b20059-00d7-498c-893a-e11b216b7dfa', '465dc108-69ee-4d78-a144-6a38d1bff473', '7420f593-e990-40cb-8162-ec0911e8cbe3'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303692800', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.manager [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:29 user cinder-volume[73579]: INFO cinder.volume.manager [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Deleted volume successfully. Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-c0761176-9a6f-40c5-9db8-d09deddd1032 tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-4b0b2c0c-f947-4182-9565-1ed37f93eb71-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Acquiring lock "cinder-29c1fac7-6099-4519-87ed-d52646075431-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-29c1fac7-6099-4519-87ed-d52646075431-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] remove_export for volume: 29c1fac7-6099-4519-87ed-d52646075431. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660293610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=29c1fac7-6099-4519-87ed-d52646075431,launched_at=2023-04-14T02:25:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth='CHAP QguyaPWR jHnz9qrO5yQued',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:30Z,updated_at=2023-04-14T02:25:30Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] detach volume v_29c1fac7-6099-4519-87ed-d52646075431 from target iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:29 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431/luns/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431/luns/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431/luns/v_29c1fac7-6099-4519-87ed-d52646075431'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431/luns/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 because of JDSS resource v_29c1fac7-6099-4519-87ed-d52646075431 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] delete target: iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] delete target iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 because of JDSS resource iqn.2010-10.org.openstack:29c1fac7-6099-4519-87ed-d52646075431 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] deleating volume v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] get snapshots for volume v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] get volume v_29c1fac7-6099-4519-87ed-d52646075431 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_29c1fac7-6099-4519-87ed-d52646075431', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440534', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112054', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17429979615229507663', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a9ec4df940e41be0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303692800', 'san:volume_id': 'a9ec4df940e41be0136a172a05d3c9434db4fcc3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84220', 'name': 'v_29c1fac7-6099-4519-87ed-d52646075431', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] delete volume:v_29c1fac7-6099-4519-87ed-d52646075431 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG oslo_service.periodic_task [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73579) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:30 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303692800', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:31 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:31 user cinder-volume[73579]: DEBUG cinder.manager [None req-7d87a46a-4205-43a2-9b64-b37eb0c5e7eb None None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_29c1fac7-6099-4519-87ed-d52646075431 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] volume v_29c1fac7-6099-4519-87ed-d52646075431 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.quota [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Created reservations ['cdf9430f-64aa-4e2c-9e9d-94ab21c85f9d', '6a28054c-3d61-46cb-9d14-d801cc1a0443', 'c9ed4d97-fe57-4fdd-b33e-b6b1c7f03994', '8160f6d4-904d-4985-9f22-06b553acb167'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303787008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.manager [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:32 user cinder-volume[73579]: INFO cinder.volume.manager [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Deleted volume successfully. Apr 14 02:25:32 user cinder-volume[73579]: DEBUG cinder.coordination [None req-ac0505b7-2968-48af-ada9-b578273aa94c tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-29c1fac7-6099-4519-87ed-d52646075431-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.coordination [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Acquiring lock "cinder-68e68ec9-98ae-4b54-a995-f5a5f5d9f948-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.coordination [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-68e68ec9-98ae-4b54-a995-f5a5f5d9f948-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] remove_export for volume: 68e68ec9-98ae-4b54-a995-f5a5f5d9f948. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098207538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=68e68ec9-98ae-4b54-a995-f5a5f5d9f948,launched_at=2023-04-14T02:25:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth='CHAP cIdFkxPz nzZUbrL9gtGT6I',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:33Z,updated_at=2023-04-14T02:25:33Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] detach volume v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 from target iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948/luns/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948/luns/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948/luns/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948/luns/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 because of JDSS resource v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] delete target: iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] delete target iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 because of JDSS resource iqn.2010-10.org.openstack:68e68ec9-98ae-4b54-a995-f5a5f5d9f948 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] deleating volume v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] get snapshots for volume v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] get volume v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440533', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112046', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5714628179747644752', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6e5022cac531a039', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303787008', 'san:volume_id': '6e5022cac531a039fed83fbe2a3864dd97c81176', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84650', 'name': 'v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] delete volume:v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:33 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] volume v_68e68ec9-98ae-4b54-a995-f5a5f5d9f948 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG cinder.quota [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Created reservations ['309a5c5c-7f45-4a26-bffb-b610f33b8080', '8c1b4183-b440-4dc1-b38e-3ae08e05f933', 'ffcdb6a1-2020-4234-8b8e-fe001a03aad9', '8227c961-5473-4148-8144-1becb0a56aef'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=5 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:UPDATE=37,cinder:SELECT=52,cinder:DELETE=4,cinder:INSERT=7 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:35 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303868928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.manager [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:36 user cinder-volume[73579]: INFO cinder.volume.manager [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Deleted volume successfully. Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-17302d38-3d8b-45ec-88f3-e87a8893457c tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-68e68ec9-98ae-4b54-a995-f5a5f5d9f948-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Acquiring lock "cinder-e752131b-8567-4094-a1e6-59772475cb28-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-e752131b-8567-4094-a1e6-59772475cb28-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] remove_export for volume: e752131b-8567-4094-a1e6-59772475cb28. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515598514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e752131b-8567-4094-a1e6-59772475cb28,launched_at=2023-04-14T02:25:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth='CHAP AHpIgKVC yA5pXaviGIm3zw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:24Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:37Z,updated_at=2023-04-14T02:25:37Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] detach volume v_e752131b-8567-4094-a1e6-59772475cb28 from target iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28/luns/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:36 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28/luns/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28/luns/v_e752131b-8567-4094-a1e6-59772475cb28'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28/luns/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 because of JDSS resource v_e752131b-8567-4094-a1e6-59772475cb28 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] delete target: iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] delete target iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 because of JDSS resource iqn.2010-10.org.openstack:e752131b-8567-4094-a1e6-59772475cb28 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] deleating volume v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] get snapshots for volume v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] get volume v_e752131b-8567-4094-a1e6-59772475cb28 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e752131b-8567-4094-a1e6-59772475cb28', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440533', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112042', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17344690158325326799', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e21bdc095577355c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303868928', 'san:volume_id': 'e21bdc095577355c7e3b180a08d95d8f52b97ac5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84641', 'name': 'v_e752131b-8567-4094-a1e6-59772475cb28', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] delete volume:v_e752131b-8567-4094-a1e6-59772475cb28 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:37 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e752131b-8567-4094-a1e6-59772475cb28 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] volume v_e752131b-8567-4094-a1e6-59772475cb28 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.quota [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Created reservations ['09f4c338-cd72-4146-8412-f57e9a0670ae', 'a0184ff2-4b57-4dc5-9e78-2925c3cf32e6', 'b40f3e69-2f4b-4d3e-8e9e-31b4a9e8e225', 'b2dfbb8c-820b-416c-8ae0-235d758ad3ba'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303950848', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.manager [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:39 user cinder-volume[73579]: INFO cinder.volume.manager [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Deleted volume successfully. Apr 14 02:25:39 user cinder-volume[73579]: DEBUG cinder.coordination [None req-87210ff3-0441-42f7-b687-bf0a395ed6a8 tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-e752131b-8567-4094-a1e6-59772475cb28-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Acquiring lock "cinder-3fda4485-897a-404c-8d9a-77a86738cc81-delete_volume" by "delete_volume" {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.coordination [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-3fda4485-897a-404c-8d9a-77a86738cc81-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] remove_export for volume: 3fda4485-897a-404c-8d9a-77a86738cc81. {{(pid=73579) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] remove export {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484741789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3fda4485-897a-404c-8d9a-77a86738cc81,launched_at=2023-04-14T02:25:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76c71f5a6204c288f89d38ea056360d',provider_auth='CHAP QFzoLZaw F1TNHBjbg6Umvt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:25:23Z,service_uuid='64523101-7c48-4142-9a47-bda428d8662f',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:25:40Z,updated_at=2023-04-14T02:25:40Z,use_quota=True,user_id='dabf32dd8cf0487d9d4edf6fb6f8a301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7f0dbc7-361a-485c-8eb6-9d153274392e),volume_type_id=a7f0dbc7-361a-485c-8eb6-9d153274392e) from target:iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] detach volume v_3fda4485-897a-404c-8d9a-77a86738cc81 from target iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81/luns/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81/luns/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81/luns/v_3fda4485-897a-404c-8d9a-77a86738cc81'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81/luns/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 because of JDSS resource v_3fda4485-897a-404c-8d9a-77a86738cc81 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] delete target: iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] delete target iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] failed to remove resource iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 because of JDSS resource iqn.2010-10.org.openstack:3fda4485-897a-404c-8d9a-77a86738cc81 DNE. {{(pid=73579) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] deleating volume v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] get snapshots for volume v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81/snapshots {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81/snapshots {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] get volume v_3fda4485-897a-404c-8d9a-77a86738cc81 info {{(pid=73579) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3fda4485-897a-404c-8d9a-77a86738cc81', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681440533', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112039', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3576197227715536532', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e893a87a40b17ea0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303950848', 'san:volume_id': 'e893a87a40b17ea0d69235c1392d978cc38fbf9b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84633', 'name': 'v_3fda4485-897a-404c-8d9a-77a86738cc81', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] delete volume:v_3fda4485-897a-404c-8d9a-77a86738cc81 recursively children:{'force_umount': True} {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:40 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fda4485-897a-404c-8d9a-77a86738cc81 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] volume v_3fda4485-897a-404c-8d9a-77a86738cc81 deleted {{(pid=73579) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:25:42 user cinder-volume[73579]: DEBUG cinder.quota [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Created reservations ['ad2e86a1-2793-4ebb-a909-f102a881bd3f', '91bf9940-0cc1-43a8-aa0c-8f5399ab1e00', 'ea923b0f-66a1-4f9d-8671-d4c8e220835f', '10006d0a-6595-47bb-88f0-dd91a320f6ae'] {{(pid=73579) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:25:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Updating volume stats {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:25:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Get pool Pool-0 fsprops {{(pid=73579) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:25:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:25:42 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:25:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Geting {'code': 200, 'error': None, 'data': {'available': '114304032768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73579) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:25:43 user cinder-volume[73579]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Total capacity: 119, Free 106. {{(pid=73579) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:25:43 user cinder-volume[73579]: DEBUG cinder.manager [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Notifying Schedulers of capabilities ... {{(pid=73579) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:25:43 user cinder-volume[73579]: INFO cinder.volume.manager [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Deleted volume successfully. Apr 14 02:25:43 user cinder-volume[73579]: DEBUG cinder.coordination [None req-02f4a7c2-f09d-49be-9887-d4c615434e79 tempest-CreateVolumesFromImageTest-165303211 None] Lock "cinder-3fda4485-897a-404c-8d9a-77a86738cc81-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=73579) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:25:56 user cinder-volume[73579]: DEBUG dbcounter [-] [73579] Writing DB stats cinder:SELECT=34,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=73579) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}